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The Modern Foreign Language 
Study in the United States’ 


HE inquiry into modern language teaching, begun in 

1924, has now been concluded. The committee in 

charge, operating under the American Council on 
Education and supported by funds appropriated by the 
Carnegie Corporation of New York, is now preparing to 
present its reports and liquidate its activities. The facts 
so far as gathered, were all in hand nearly a year ago, and 
the period intervening since that time has been devoted to 
bringing the material into shape for publication. This has 
turned out to be a much longer task than was anticipated, 
but the reports of the Committee and the special studies on 
which they are based are all nearing the final step of publi- 
cation. Three monographs have indeed already been pub- 
lished by the American and Canadian committees, and one, 
Professor O’Shea’s study of ‘“‘The Reading of the Modern 
Languages After Graduation,”’ by the Bureau of Education.* 


1 Report submitted at the annual meeting of the American Council 
on Education, May 4, 1928. 

2 The following is a list of the publications of the American and 
Canadian committees, including those which have already appeared 
and those which are to be published (Oct. 1): 

Vol. I. New York Experiments with New-Type Modern Language 
Tests, by Ben D. Wood. The Macmillan Company, 1927. 

Vol. Il. A Laboratory Study of the Reading of Modern Languages. 
by G. T. Buswell. The Macmillan Company, 1927. 

Vol. III. A Graded Spanish Word Book, compiled by Milton A, 
Buchanan. The University of Toronto Press, 1927. 

Vol. IV. Enrollment in Foreign Languages in Secondary Schools and 
Colleges of the United States, compiled by C. A. Wheeler, and others 
with introduction and analysis by Robert Herndon Fife. The Mac- 
millan Company, 1928. 

Vol. V. Achievement Tests in the Modern Foreign Languages, by 
V. A.C. Henmon. The Macmillan Company, 1928. 

Vol. VI. Modern Language Instruction in Canada, Part I. The 
University of Toronto Press, 1928. 
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In press are a statistical report, a German word book, and 
idiom frequency studies in Spanish and German. Ready for 
press and awaiting the final mechanical details are volumes 
on achievement tests, on the training of modern language 
teachers, and on the objectives, organization and methods 
of modern language courses, as well as volumes containing 
studies of prognosis in the modern languages, compilations 
of words and idioms based on frequency counts and a series 
of monographs on special topics differing as widely from 
each other as the influence of the learning of French upon 
the acquisition of an English vocabulary and experiments 
in sectioning classes in Romance languages in a middle- 
western university. 

The EpucaTIoNaAL Recorp of October, 1927, contained a 
general summary of the findings of the Committee on In- 
vestigation of the Modern Language Study which traversed 
in detail its experiences and attempted to describe the general 
character of the results as well as to outline the tasks which 
it has been obliged to leave unfulfilled. The Committee on 
Direction and Control of the Study voted at its final meeting 


Vol. VII. Modern Language Instruction in Canada, Part II. The 
University of Toronto Press, 1928. 

Vol. VIII. An Annotated Bibliography of Modern Language Meth- 
odology, compiled by Milton A. Buchanan and E. D. MacPhee. The 
University of Toronto Press, 1928. 

Vol. IX. A German Frequency Word Book, arranged and edited by 
B.. Q. Morgan. The Macmillan Company, 1928. 

Vol. X. A German Idiom List, compiled by Edward F. Hauch (in 
press). 

Vol. XI. A Spanish Idiom List, compiled by Hayward Keniston 
(im press). 

Vol. XII. The Teaching of Modern Foreign Languages in the United 
States, by A. Coleman (in press). 

Vol. XIII. The Training of Teachers of the Modern Foreign Lan- 
guages, by C. M. Purin (im press). 

Vol. XIV. Prognosis Tests in the Modern Foreign Languages (in 
ms.). 

Vol. XV. A French Frequency Word Book, compiled by V. A. C. 
Hemnon and George E. Vander Beke (in ms). 

Vol. XVI. A French Idiom List, compiled by A. Coleman and F. D. 
Cheydleur (in ms.). 

Vol. XVII. Studies in Modern Language Teaching (in ms.). 
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in Toronto in September last to conclude its existence this 
spring with the completion of the reports and other studies 
and to ask the American Council on Education to appoint 
a new committee which, acting under the sponsorship of 
the Council, as the former committee has done, should seek 
to continue the work of research and experiment in the field 
of modern language teaching. This new committee will also 
undoubtedly seek to make use of the contacts which have 
been established with schools and colleges, with members of 
faculties of education and research organizations which are 
interested in experimentation in modern language teaching. 
It will find much to do, for, as has been repeatedly pointed 
out, an inquiry like that which has just been concluded does 
nothing so effectively as to lay bare what is still to be done. 

The new committee will find the beginnings of a testing 
equipment assembled by its predecessor, and it will need, 
first of all, to improve and enlarge this. Its main activity, 
however, should lie in the direction of applying the present 
American Council tests and others yet to be devised to the 
solution of some of the ancient problems of our craft, prob- 
lems which have awaited the development of a psychological 
technique for measuring achievement in the various skills 
and capacities in language use. The effect of age upon the 
learning of the modern languages; the actual psychological 
processes involved in the complex development which we 
call learning a foreign language; the effect of a cessation of 
language study upon knowledge of the language; the inter- 
influence of the acquisition of several capacities, such as 
oral expression, aural comprehension, comprehension through 
silent reading, active and passive command of vocabulary, 
etc., upon each other; the possibility of predicting success 
or failure in language study—all of these are questions 
‘which can be studied successfully only with the aid of care- 
fully controlled classes and through a number of years. 
Furthermore, the search for the basic elements of foreign 
language material and the minima of these necessary for a 
reading knowledge, and experiments to determine the short- 
est road by which the American boy or girl can attain this 
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most desirable of all foreign language objectives, are under- 
takings which should be pushed forward without delay. 

To meet these demands, the new committee will un- 
doubtedly ask that any balance remaining when the respon- 
sibilities of the present study have been discharged shall be 
placed at its disposal, together with the income accruing 
from the sale of modern language tests published by the 
World Book Company under the copyright of the American 
Council and from royalties which may be earned by the 
curriculum studies to be published. It will necessarily have 
to seek funds for a campaign of experimentation and research 
extending over a period of years. Among other tasks which 
should have its immediate consideration is the establishment 
of a national center for the distribution of information to 
schools and colleges regarding all phases of modern language 
teaching.* 

In this final report it is not necessary to repeat a review 
of accomplishments. Since educational surveys and, in 
particular, surveys of curriculum subjects seem to have 
become the fashion, it may be of some interest and perhaps 
of suggestive value to those who are planning such under- 
takings to traverse a few of our experiences and, finally, to 
call attention to some of our findings which are of especial 
importance for school and college administrators. 

The proper method of procedure in a national study of a 
curriculum subject is certainly the least standardized of all 
educational enterprises. Should such a study be entrusted 
to curriculum-subject experts or to experts in education or 
to both? The decision of this question brings advantages 
and disadvantages in whichever direction it may fall. The 
curriculum expert looks upon the task as one of apology 
and defense. If he finds fault too insistently with present 
methods or takes any other position than that of a thick- 
and-thin advocate, he hears from his colleagues of the guild 
that he is giving aid and comfort to the enemy. On the 
other hand, surveys conducted by experts in education are 


* Cf. the program outlined by the Committee on Direction and Con- 
trol, EDUCATIONAL ReEcorp, VIII, 4, 264 ff. 
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handicapped by too great respect for merely quantitative 
methods and too little regard for traditional methodology 
and for the experience of trained and observant teachers, 
which has also a really scientific value. The recent rapid 
expansion in the application of statistical methods to re- 
search has led in some quarters to an intoxication with the 
idea that education is an exact science and to a belief that 
all of its main problems can be solved by mass inquiries. 
The airy and oracular manner in which some educationists 
proclaim a priori theories regarding the social aspects of 
curriculum subjects is especially galling to the curriculum- 
subject teacher, most of all if he be a teacher of one of the 
older disciplines. He hears in them an undertone like the 
rhapsody of the Bachelor of Arts in Goethe’s Faust: 

The world was not ere I created it; 

The sun I drew from out the orient sea; 

The moon began her changeful course with me; 

Who save myself to you deliverance brought 

From common places of restricted thought? 

I proud and [ree even as dictates my mind, 

Follow with joy the inward light I find, 

And speed along in mine own ecstasy, 

Darkness behind and glory leading me! 

Of course, no really fruitful curriculum study can take 
place without the aid of both experts in education and ex- 
perts in curriculum subjects, but it is not easy to make the 
proud lion and the equally proud, though usually helpless, 
lamb lie down together. 

There are also regional diversities which are in this country 
greater than most people dream of. This is especially true 
of the teaching of modern languages. Mathematics and 
Latin may have a certain national validity, but French in 
Massachusetts is something quite different, both for the 
school principal and the teacher, from French in Alabama 
and in Minnesota, and Spanish in the Southwest has a reality 
which it never attains in the north-central states. If there 
is ever to be a national curriculum for the secondary school, 
it will have to be elastic as regards the modern languages. 

Another great handicap for a national study of any curric- 
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ulum subject is the short time within which it must be 
concluded. The classical investigation took three years. 
The financial backers and the official backers for the modern 
language inquiry have been very sympathetic as regards the 
extension of time, and we have been carrying on for over 
three and a half years, which will probably extend to four 
years before all of our reports are distributed. Nevertheless 
we have felt badly cramped for time from the first. As a 
matter of fact, after deducting the period for organization 
and preliminary surveys of the field and the long time which 
is necessary to prepare the manuscripts of the reports for 
the press and to put them into the press and through the 
ptess, two years is the maximum time that even the most 
long-suffering backers of such an enterprise can allow for 
assembling the statistical material from the schools and 
other sources, constructing and administering tests, outlining 
problems of research, finding persons to undertake them 
and gathering in the results. The rest of the time goes into 
getting ready and getting through. 

Under these circumstances a curriculum-subject study 
has to depend very largely on quantitative methods. Sta- 
tistics count for a great deal with most people, and these at 
least are something that can be gotten together. It is not 
a question of money alone. We shall spend on the inquiry 
and on publication, all told, about $200,000, and the Cana- 
dian Committee about $90,000, which is just about what 
the budgetary forecasts were throughout the course of the 
investigation. We can truly be grateful that the sum was 
no larger, for there is an absolute limit to the amount of 
money which an ad hoc organization, consisting in large 
part of volunteer workers, can safely administer, just as 
there is a sharp limit to the amount of executive energy 
which a group of men brought together for a temporary 
performance can develop. 

The Modern Foreign Language Study had to start with 
the usual difficulties and jealousies, institutional and per- 
sonal, and some quite particular ones as between the three 
modern languages most widely studied. It had to face the 
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necessity of getting together a national and regional organ- 
ization and the much more difficult task of finding men 
who could be borrowed for one or two or more years from 
the institutions where they were working and who would 
then carry on for another year in the midst of their full- 
time duties. It had to decide how each task could be lim- 
ited so as to bring it within the range of possibility. For 
this reason, the committee resolved to confine the inquiry 
to the secondary schools and to the corresponding levels of 
college instruction, leaving more advanced courses and all 
non-institutional work out of consideration. It has turned 
out that this was a wise decision, for the investigation has 
shown that even in the colleges less than 35 per cent of 
modern language students are found above the second year 
of instruction. Furthermore, another question had to be 
decided which was quite important for the direction of the 
investigation. Should the committee devote itself to a few 
basic problems or seek to mobilize teachers and scholars on 
as wide a scale as possible to participate in the gathering of 
facts and in experimentation? It chose the latter alterna- 
tive. This decision was made with great reluctance, and 
time alone can show whether it was wise. It would certainly 
have been an inviting task if the committee could have 
concentrated its efforts and money on a few basic question, 
such as the best age for beginning the study of the modern 
languages, the length of time necessary to learn the minimum 
essentials for a reading knowledge, or the influence of prac- 
tice in speaking and writing French, German or Spanish on 
the ability to read these languages. What it did was to 
map out a program which would explore present conditions 
in modern language teaching on as wide a scale as possible 
and to invite as many persons to cooperate as there was any 
probability of its enlisting. 

The difficulty which caused the most trouble at the be- 
ginning was probably the result of war-time psychology. 
During and immediately after the war much was heard 
about the delimitation and definition of objectives and par- 
ticularly about the objectives of secondary school instruc- 











196 THE EDUCATIONAL RECORD 


tion. It was a sort of revaluation of values, and our Com- 
mittee on Investigation spent many hours in session trying 
to select the direct and indirect objectives, the primary and 
ultimate objectives, the scholastic and social objectives of 
modern language study in America, until we finally grew to 
hate the word ‘“‘objective.”” It is now clear that much that 
is said about objectives in education is as genuine dialectics 
as was ever perpetrated by the medieval schoolmen, fitted 
only for orators at teachers’ meetings or for syllabus mongers 
who try to fill the gaping, empty spaces in actual knowledge 
with beautiful and resounding phrases about “preparation 
for civic responsibility”’ and ‘‘cultural”’ and ‘‘esthetic val- 
ues.’’ At last it became clear that the only way to begin 
a study of modern language teaching was to adjourn the 
discussion of ideal objectives of instruction and take hold 
of the schools as a living organism which mankind has de- 
veloped out of the necessities of existence and progress and 
not out of the logic of the metaphysical seminary; in other 
words to find out what the schools actually were doing in 
language study. 

This could only be accomplished by the wide use of stand- 
ardized tests. These were as yet for the most part lacking. 
It was necessary to make and standardize tests, and this 
was a process which absorbed most of the committee’s time 
and energy for more than a year. It threw it behind its 
schedule and cost a great deal of money, some of which was 
as good as thrown out of the window. What was finally 
brought through seems little enough, testing as it does only 
four capacities—vocabulary, grammar, reading and writing 
—in place of eight or nine which should be tested; but at 
least these standards of measurement have been devised 
and applied to 50,000 students in this country from New 
England to California and to other thousands in Canada 
and England, so that it is possible to fix norms in school 
and college for the three modern languages up to eight 
semesters of training. 

Long before these tests had been brought to a position 
where they could be applied with confidence, the committee 
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had realized the futility of trying to test the attainment of 
the ultimate objectives of modern language teaching at any 
time within the life of its undertaking. It realized, also, 
that objectives in any study vary with the factors of age, 
social and economic conditions, geographical situation, and 
a myriad other things which concern the schools. A little 
experience with testing showed that the American secondary 
schools are wrestling with problems of a very elementary 
character, fundamental questions concerning organization, 
selection and classification of pupils, the proper age and 
minimum period of study of the several curriculum subjects, 
the establishment of some standards of achievement and the 
enlistment of adequately trained teachers—all of which fall 
with tremendous incidence on modern languages. 

Thus the program of objectives had to be translated into 
a series of problems of organization, curriculum-material, 
method, prognosis, etc., and these problems distributed as 
widely as possible among educationists and modern language 
teachers. Wherever it was possible, the mutual cooperation 
of both was solicited. Who should and who should not 
study the modern languages? What are the minimum bases 
of language in vocabulary, in grammar and in writing and 
speaking which the student who has entered on a foreign 
language course should acquire before he is permitted to 
discontinue study of the language? How do the various 
capacities influence each other in learning? How does the 
study of French or German or Spanish affect the learning 
of English? How do pupils learn to read? What are the 
minimum essentials of grammar for learning to read? What 
is the proper age to begin? What is the shortest time within 
which the study of the language may be carried on in the 
schools in order to make it worth while in the curriculum? 
Most of these problems, of course, still remain problems, 
and the amount that the results of the inquiry are able to 
contribute to their solution seems pitifully small. Some are 
questions which would require controlled classes through 
ten years to illuminate and others can only be attacked when 
the testing tools are much more refined than they are at 
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present. Controlled classes are just what an inquiry of the 
kind which has just been concluded cannot properly bring 
through. They need careful planning and, above all, trained 
supervision at every stage, and the facilities for all of this 
are lacking in the rush of a short-living undertaking which 
must be carried through by a temporary organization. 

It may be said that the student of any curriculum subject 
must at the present stage of American secondary education 
set to work to devise and create the tools for measuring 
achievement at the very time when he should be employing 
those tools to determine existing standards, for there is no 
curriculum subject at the secondary school level which has 
at the present time anything like an adequate supply of 
such tools. That the Modern Foreign Language Study has 
failed to carry out the program which it set itself and is 
now bringing into press reports which should be already 
distributed, is due to this cause, which must also affect 
every other undertaking of a similar character. By the 
time the second year of the inquiry had passed, the commit- 
tee was overwhelmed with material, and another six months 
had gone by before it could distinguish the town for looking 
at the houses. Even now it is painfully aware of a mass of 
facts which is insufficiently correlated and digested and which 
may, nevertheless, not be withheld any longer from publi- 
cation. 

The major undertakings have all gone through to some 
sort of completion. Highly analyzed statistics have been 
tabulated for about 83 per cent of the secondary school 
population and the same percentage of the modern language 
school enrollments in the United States, with similar figures 
for more than half of the college enrollment. Information 
regarding the training and present duties of 10,000 modern 
language teachers is ready for publication. National norms 
of school and college attainment in modern languages on 
the basis of a wide testing campaign have been set up, and 
the tests themselves and the achievement of the schools as 
measured by them have been carefully analyzed for this 
country, Canada and England. One can say, at least in a 
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general way and on the basis of statistical findings, what is 
now accomplished by the schools and colleges in the various 
semesters of study throughout the United States and 
Canada and by certain classes of schools in England. One 
can measure through the overlapping of achievement in the 
various semesters the utter lack of any real standards for 
classification, with its devastating results on the progress 
of brighter and slower students alike. One can see in cold 
figures the damage wrought by unsupervised teachers work- 
ing with syllabi made up by the pernicious old method 
of patching together a new syllabus out of six old ones. 
One can now see how unfortunate for modern language teach- 
ing is the whole illusion, so carefully nursed by the propa- 
gandists of every curriculum subject, that any student who 
hopes for intellectual salvation must study that particular 
curriculum subject. Furthermore, cooperative undertakings 
on a large scale have been carried through by modern lan- 
guage teachers, with adequate statistical advice, in the 
search for the fundamental bases of French, German and 
Spanish for teaching purposes in the words and idioms and 
grammatical phenomena of these languages. The materials 
which were assembled have been organized in frequency 
sequences so that they present minima of the language 
which may be used as a rough basis of selection for successive 
years of study. In other words, the committee will be able 
to offer some suggestions for syllabus material based on 
logic and experiment rather than on tradition and subjective 
selection. 

Having thus canvassed the general progress of the inquiry, 
let us now examine its general findings. What are the out- 
standing impressions that result from a study of this char- 
acter, which has mobilized so many thousands of school 
principals and language teachers and private citizens, be- 
sides many technical scholars in the modern languages and 
in education? 

In an investigation of such proportions one is inevitably 
forced into statistics. It can, I think, be said with assur- 
ance that no such body of American schools and colleges 
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has ever before been submitted to an analysis for the facts 
relating to any curriculum subject. The general figures are 
of course the least important. It cannot be a matter of 
particular interest to anyone to know that at the present 
time the public secondary schools are teaching French to 
approximately 440,000 children, Spanish to 305,000, German 
to 35,000, and Latin to 790,000 pupils; or that the total 
public school enrollment in the modern languages, taken 
together, is slightly over 20 per cent of the entire public 
school population and the private school enrollment in these 
languages nearly 50 per cent of the total private school 
population. Those interested in the secondary school curri- 
culum will, however, look for the regional aspects of the 
enrollment, its relation to the other language offerings, 
especially the relationship between the modern foreign 
languages and Latin, and its relation to the different types 
of schools and in particular to the size of the schools and 
of the communities in which they are located. More im- 
portant still for the student of organization and of standards 
in the schools are the distribution of foreign language pupils 
in the grades, the period when the study of the language is 
prevailingly begun and the continuity of foreign language 
study in the schools and colleges. It may therefore be of 
interest to analyze these aspects of the situation a little more 
closely, even though this results in the introduction of some 
rather monotonous statistical material. 

In the first place, it is a significant, although not unex- 
pected, discovery that national and regional percentages of 
modern language enrollment rise directly with the size of 
the community and with the size of the school. There are 
only two sections in the country where this is not true—New 
England and the Southwest. Here the modern languages 
invade the small communities, and it is precisely in these 
regions that French and Spanish enrollments show large 
percentages of the school population as compared with 
Latin. In New England the smallest communities have a 
larger proportional enrollment in French than cities of 
30,000, while in the southwestern states, from Texas to the 
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Pacific, Spanish is a rural school subject to the same extent 
as it is an urban subject. Latin takes exactly the opposite 
direction, since its share in the total enrollment decreases 
regularly as we pass from the smaller to the larger commu- 
nity and also, although not quite so regularly, from the 
smaller to the larger school. It is relatively smallest in the 
largest cities and largest schools, so that while two-thirds 
of the Latin enrollment is to be found in schools in commu- 
nities of less than 30,000, 60 per cent of all modern foreign 
language pupils live in communities above that figure. 

These are conclusions that might have been inferred from 
the general public attitude toward modern language study 
and especially from the well-known difficulty which the 
smaller schools encounter in finding trained modern lan- 
guage teachers. It is probably well known also, that, na- 
tionally speaking, Latin is the most widely taught of all 
foreign languages. If we should divide the secondary school 
pupils of the country into groups of 100 each, we should 
find in each group approximately 23 studying Latin, 13.6 
studying French, 9.2 studying Spanish, and 1.2 studying 
German, with a very tiny fraction engaged in the study of 
all the other foreign languages. The regional distribution 
of modern language study is, however, not so well known, 
and the exposure of this in detail will undoubtedly be an 
important contribution when the reports of the study appear 
from the press. There are, broadly speaking, only two 
sections of the United States which are vitally interested in 
the modern languages in the schools, if figures are significant. 
These are New England, New York and New Jersey on the 
one side, and the southwestern states on the other. In 
New England the French tradition persists. Out of 752 
schools tabulated in the six states, only 31 have no French 
enrollments. NNew Hampshire leads the way, with nearly 
half of the students in the state enrolled in French classes. 
Massachusetts, for which we have nearly 100 per cent figures, 
reports only one high school without French. Latin follows 
as a second foreign language, but everywhere at a respectful 
distance. 
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In the middle Atlantic states, French has a strong hold 
and Spanish an increasing one, but both must yield the 
premier position to Latin. As we go southward and west- 
ward the Latin fetish grows in importance, and the ancient 
language forms everywhere a high percentage of the total 
school enrollment. The pupil interest in French and 
Spanish is scarcely anywhere one half so great. Even in 
Louisiana twice as many schools offer Latin as offer French. 
This was as great a surprise to one member of the Committee 
of Investigation as it was to find that tradition and the 
proximity of Spanish countries make Spanish in Florida twice 
as popular as French is. West of the Appalachians and 
north of the Potomac and the old Spanish line, Latin still 
rules the public high schools with little interference from the 
modern languages. Throughout the Middle West and North- 
west 96 per cent of the schools report Latin students, and 
these students are three times as numerous as French pupils 
and five times as numerous as Spanish pupils. 

It is only when we approach the border of the old Spanish 
territory that modern language interest rises again and here, 
of course, it is a Spanish interest. Oklahoma is the first 
state after one leaves the Atlantic seaboard where a modern 
language exceeds Latin in enrollment. In this state five 
schools offer Spanish to one that offers French. When we 
cross into the region where the flag of Spain once waved, 
Spanish studies rule supreme in the schools and 80 per cent 
of the public secondary schools teach this language. Even 
Colorado has three Spanish schools to one of French, and 
judging from the percentages of enrollment, French is only 
one-third as popular with students in this state as the lan- 
guage of Coronado and Narvaez. In California, Spanish 
appears on the programs of 95 per cent of the secondary 
schools and far exceeds both Latin and French in pupil 
popularity. 

In the whole valley of the Mississippi and the Missouri, 
modern language interest is almost exclusively an affair of 
the large centers and large schools, while Latin rules in the 
entire field. For example, on examining the modern language 
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reports from the state of Iowa, where the state university 
has devoted much time and energy to successful experimen- 
tation in modern language teaching, we find that the total 
enrollment in all modern languages in the secondary schools 
is (or was in 1925-26) barely 6 per cent of the total school 
population. When one sees such figures it becomes quite 
clear why the Mississippi Valley and the northwest have 
little interest in the League of Nations nor any international 
problems. One can even begin to understand Mayor 
Thompson of Chicago. The thing which one cannot under- 
stand, except through the dead hand of tradition, is the 
vogue of Latin even in the smallest schools in the rural 
communities of the Missouri Valley. In the whole group 
of states between the Mississippi and the mountains and 
lying south of the Dakotas, Latin enlists nearly half of the 
students in the public high schools of less than 100 pupils. 
More than one-third of the secondary school population of 
Nebraska, for instance, is enrolled in Latin classes. 

Those who have administrative problems at heart can 
hardly fail to regard as important any light which may be 
thrown by statistics on the period of beginning modern lan- 
guage study and its position in the school grades. 

It is a well-known fact that the modern languages differ 
from all other school subjects in that they may be entered 
upon by the student at any stage of his learning career, 
from the seventh or even the sixth grade through all the 
junior and senior high school and college years, and even in 
the graduate years for research purposes. 

It is only in New England and New York and the South- 
west that any considerable number of pupils commences 
modern language study in the junior high school grades. 
In the regular high school grades the association of French 
or German or Spanish with Latin reacts to the disadvantage 
of the modern language, as 80 per cent of Latin students in 
the country begin that language in the 9th grade. For 
French the beginners in the 9th, 10th and 11th grades are 
singularly equal, while for Spanish beginners the 9th grade 
predominates. It is significant that the number of Latin 
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beginners in the last two grades of high school (the 11th 
and 12th) nowhere in the country teaches 10 per cent of the 
total number of Latin beginners. What is the proper age 
for beginning modern language study? No one can answer 
that question; but it is certainly of significance for the 
length of the period during which study is continued that 
58 per cent of all students of French and one-half of all 
students of Spanish do not begin the subject until the tenth 
grade, while over 80 students of Latin begin its study earlier. 
These figures are of importance when we come to consider 
the question of discontinuance of language study in school 
and college. This is closely related to the whole question 
of objectives, organization and methods, and indeed looms 
in the background of every question involved in modern 
language teaching. The figures collected by the Committee 
on this point are borne out by regional surveys, such as 
statistics published at various times by the North Central 
Association. They show that more than half of the secon- 
dary school students in each of the foreign languages, in- 
cluding Latin, are to be found in the first year of study. 
German scores the largest percentage in the first year and 
Latin the lowest, but the differences are not great. In the 
first two years of study we find 87.5 per cent of all French 
students, 92.5 of all German, 91.7 of all Spanish, and 86.6 
of all Latin. A very small percentage, indeed, carries on 
into the fourth year. These figures do not take into consid- 
eration the réle which dropping out of school plays in the 
default in the modern languages; but a rough calculation 
based on the statistics of grade distribution in the report of 
the Commissioner of Education for 1922 shows that pupils 
in the regular high schools drop the modern languages from 
50 to 100 per cent faster than they drop out of school. 
Many of these students could not continue the subject for 
a longer period because they began it only in the 11th grade. 
In general, however, this is invalid as a reason for discon- 
tinuance, for the figures show that while nearly 77 per cent 
of the French pupils in the public secondary schools of the 
country begin the course early enough to have continued 
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it for three years, less than 14 per cent of this group embrace 
the opportunity. Does any considerable number continue 
the subject in college? In partial answer to this question 
the Study has figures for the Freshman enrollment in 204 
colleges of liberal arts, representing not far short of one-half 
of all the Freshmen in this type of institution in 1925. Of 
these, 21 per cent presented two points of French for ad- 
mission, representing two years of school preparation, and 
less than one-half of these continued the study of the lan- 
guage in college. 

The all-prevailing two-year course in the modern lan- 
guages seems to afflict the colleges almost as badly as the 
preparatory schools. The committee collected figures from 
293 colleges of liberal arts with an undergraduate enrollment 
of 259,000. These include, however, approximately 75 per 
cent of institutions whose baccalaureate degrees are accepted 
for graduate study by the Association of American Colleges. 
From these returns the interest in modern language study 
appears to be relatively twice as great in the colleges as in 
the secondary schools of the country, for if we may judge by 
the sample investigated, 57 per cent of the undergraduate 
bodies in 1925 were enrolled in modern language classes. 
It is a significant, and for the American colleges a lamentable 
fact that nearly 40 per cent of all the modern language 
students in undergraduate courses are in the first year of 
language study. In general, the colleges for women furnish 
here a more favorable picture than colleges for men; the 
number of advanced students—i.e., students above the 
second year of language study in French and Spanish—is 
larger and has increased more rapidly in women’s colleges 
than in colleges for men and in coeducational institutions. 
French is prevailingly more widely elected in women’s col- 
leges than in men’s colleges; the ratio is 50 per cent as com- 
pared with 39 per cent. German, on the other hand, is 
even more decidedly a subject for men’s colleges, while the 
two sexes tend to study Spanish in relatively equal numbers. 
As a whole, French enjoys a considerable preference among 
college students over other modern foreign languages, en- 
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listing 29 per cent of all undergraduates; Spanish stands next 
with 17 per cent of the total enrollment, and German follows 
with 10 per cent. Finally, as documentary evidence of a 
richer modern language interest in the colleges than in the 
secondary schools, it may be noted that French is more 
than twice as popular, Spanish nearly twice as popular, and 
German, which is now distinctly a college subject, more than 
five times as popular in college as in secondary school. 

The most outstanding result of the analysis of modern 
language enrollments in school and college is the astounding 
brevity of the courses pursued by an overwhelming majority 
of students. For 87 per cent of secondary school pupils in 
French classes and more than 90 per cent of those in German 
and Spanish classes, two years is the maximum period of 
study. In the colleges 55 per cent of all students of French 
are in the first two years of study; nearly half of all Spanish 
students and more than half of all German students are in 
the first year. 

Does this mean that the American boy and girl look upon 
two years as the normal length of time in which to acquire 
a foreign language’? School administrators and observers 
of education quite generally are gravely dissatisfied with 
the present results in teaching the modern languages, and 
the evidence brought in from test administrations in the 
past two years supports this criticism. The results of mod- 
ern language teaching are such that they can be checked up 
with fatal exactness in after life. With marked regularity 
every year or two some college or university president or 
other apostle of education rises in our midst and solemnly 
and officially declares that modern language teaching is a 
failure. The candidate for the doctor’s degree who after 
three or four years of disuse finds himself called upon to 
pass an examination in German; the alumnus who after 
wrestling for twenty years with the manufacturing or market- 
ing of textiles takes a summer trip abroad; the scientist who 
is suddenly vis-a-vis an important untranslated article on 
nitrates—all take occasion to assail the utter uselessness of 
early instruction in French and German. Each forgets, of 
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course, that all of his algebra and geometry have been left 
to guard the schools, that he has forgotten every sentence 
from his four or more years of Latin except that which notes 
the tri-partite division of ancient Gaul and every play of 
Shakespeare except those that appear west of Broadway, 
but he resents it bitterly that two years of French or German 
did not give him the capacity, continuing amidst years of 
discontinuance, to apprehend or express thoughts in the 
foreign language. 

We must, nevertheless, accept things as they are and seek 
such remedies as the conditions of the American school and 
college curriculum admit. It is quite certain that even in 
the present situation admirable work is being done in teach- 
ing the modern languages in certain American schools and 
colleges, although it is not fair of course to judge the second- 
ary schools by what may be accomplished in colleges and 
in private schools where the pupil material is selected for 
ability and for its cultural motivation. These are conditions 
which it is not possible to transfer to the public secondary 
schools, where the modern languages are now fighting a 
difficult battle. 

How can they be helped? All that can be done here is 
to point out a few of the directions which have been shown 
by experiment to offer fruitful possibilities. 

1. By a method of selecting students. It is hard to see how 
definite and worth-while objectives can be attained in mod- 
ern language courses unless there is some reliable method 
of eliminating incompetent students. It is for this reason 
that the Study has given a great deal of attention to the 
question of prognosis tests, and while the whole matter is 
still in its beginnings and the reports to be published are 
still inconclusive, they constitute, at all events, a beginning. 
Until adequate prognosis tests are devised, intelligence tests 
will have to suffice. At least with such tests as the committee 
has produced, it is possible to eliminate failures after a trial 
period of one or two semesters with greater certainty than 
before. 

2. By the administration of objective, standardized tests for 
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the ascertainment of school and college norms and for diag- 
nostic purposes. These will act as a critic and a corrective 
for every experiment in curriculum and method. 

3. By the development of progressive curriculum material 
based on studies of word and idiom frequencies as well as on 
the study of the subject matter of reading tests for cultural 
material, such as history, national customs and realia of 
various kinds. This will sharpen the objectives of instruc- 
tion and establish validity for tests. 

4. By a study of the minimum essentials of grammar, vo- 
cabulary, idiom, etc., to the end that the process of learning to 
read may be accelerated. It is not possible here to go into 
the question of the relative importance of objectives, but 
it seems certain that reading is quite generally regarded as 
the first objective for the American student. Fruitful ex- 
periments have been begun at the University of Chicago 
and elsewhere for the development of techniques for teach- 
ing students to read, including experiments with the mini- 
mum essentials in grammar and the minimum and optimum 
of vocabulary selection. If two years is to remain the 
period which 85 per cent of our students will give to foreign 
language study in school and almost as large a percentage 
in college, the best method of investing this time for the 
primary objective is a problem which challenges the inge- 
nuity and persistence of administrators and teachers alike. 
No other nation faces it in the same way. 

The Modern Language Study and Canadian Committee 
will not be able to open any royal roads to success in meeting 
these or any other problems of modern language teaching. 
All that they can hope to do is to lay bare the difficulties 
of the situation and show some of the directions in which 
research and experiment may lead to improvement. 

RoBERT HERNDON Fire, 
Chairman. 

















Occupational Destination of Ph.D. 
Recipients 


N AN earlier paper? the writer reported the present 
| occupation of 1,464 persons who had received the degree 

of doctor of philosophy from the University of Chicago, 
this being the total number of recipients of this degree from 
the beginning of the University to December, 1924. The 
tabulation showed that 77 per cent of all such recipients 
now hold teaching or other positions in high schools, colleges 
and universities, public and private, in this country and 
abroad. The remaining 23 per cent are engaged in business 
and in professional work other than education. The signifi- 
cance of this finding, which was merely confirmatgry of 
general opinion in regard to the matter, seemed to the com- 
mittee* for whom the study was made to warrant an analysis 
of data from other graduate schools which are members of 
the Association of American Universities. 

The attempt to secure such data already analyzed from 
these institutions proved abortive, since it was uniformly 
reported by deans of graduate schools that no study of the 
matter had been made. The one exception to the flood of 
negative replies was the case of Johns Hopkins which had 
but recently published an alumni directory and a classifica- 
tion table showing the present occupation of its doctors. 
From three institutions‘ recently published alumni directo- 
ries were received. 

Fortunately, these directories give explicit information as 
to the nature of the degree received, the field of specializa- 


1A report prepared for the Committee on Professional Training of 
the North Central Association of Colleges and Secondary Schools. 

? Haggerty, M. E.: “‘ The Professional Training of College Teachers.” 
North Central Association Quarterly, Vol. II, p. 108 ff. 

’ Committee on Professional Training of College Teachers of the 
North Central Association of Colleges and Secondary Schools. 

4 Harvard University, Princeton University, University of Wisconsin. 
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#cuow, iADrarian, Nesearcher, Student. 
2 Details of ranks, etc., omitted from this table. 
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tion, and the name of the institution where now employed 
with rank or title, or the business in which the individual is 
now engaged. In the initial tabulation full use was made 
of all these details. Thus the Harvard data distributed 
themselves as in Table I. 

Material for this type of distributions was finally secured 
from three of the large private institutions and from three 
state universities. The data for the University of California 
was furnished in tabulated form by Dean Charles B. Lipman, 
Miss A. B. Flournoy, and Miss Carmel D. Riley. For 
Harvard, Princeton, Chicago, Johns Hopkins, and Wisconsin 
use was made of printed alumni lists, and the Minnesota 
material was taken directly from the records in the office 
of the Graduate School. 

From the summarized data appearing in Table II, it is 
clear that teaching and other educational work claim the 
major portion, almost three-fourths, of those who receive 
the doctor’s degree from American universities. It is not 
far from the truth to say that for the greater number of 
those who become doctors of philosophy the degree is essen- 
tially a teaching degree. It is the badge of scholarship 
requisite to the highest teaching positions, and makes en- 
trance into the more modest ranks easier than it would 
otherwise be. 

Certain interesting facts of the present occupation of 
doctors of philosophy are apparent in the detailed distribu- 
tions of data (Table III). A small percentage of doctors, 
2.2 per cent of the entire group, are in business. All of the 
institutions share in this total. The actual number is prob- 
ably greater than is shown in the business column since a 
portion of the unknown probably belong here. Possibly 
3 per cent would be the approximate figure. The professions, 
broadly interpreted, have claimed about one-sixth (16.3 per 
cent), law, medicine, and the specialized scientific tech- 
nologies comprising the major portion of this group. Of 
the sciences chemistry claims the largest number. 

The degree to which research is the major occupation may 
be gleaned by a study of the separate columns in which 
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TABLE II.—Number and Per Cent of Ph.D. Recipients in 
Educational Work 


Three Public Universities and Four Private Universities 

















No. in | No. not | Per cent 5 
educ. | in educ. | in educ. Ph.D’s. 
Private Universities: 
Harvard University........ | 1,172 334 77.82 1,506 
Princeton University....... 232 98 70.30 330 
oom Hopkins University... 935 448 67.61 1,383 
Jniversity of Chicago...... 1,133 331 77.39 1,464 
Total in Private Universities. .| 3,472 1,211 74.14 4,683 
Public Universities: 
University of Wisconsin. .... 142 100 58 .68 242 
University of California..... | 379 155 70.97 534 
| 126 61.82 330 











University of Minnesota... .| 204 
| 
| 


Total in Public Universities...| 725 | 381 65.55 1,106 





Total Public and Private | 
I nn wicca aioe | 4,197 | 1,592 72.50 5,789 











research workers are listed. If we include the research 
foundations column, which probably designate administrative 
officers as well as technical workers, there are seven of these 
columns. Of the total of 5,789 doctors from the seven 
institutions, 711, or 12.3 per cent, describe their work as 
that of research. The Chicago data are not distributed, 
but if this were done the percentage would be approximately 
16.4. Slightly less than 3 per cent are expert workers in 
government service, local, state, and national. 

It is not possible to learn from the data in hand the degree 
to which doctors listing other occupations such as teaching, 
administration, etc., actually engage in research. This fac- 
tor varies, of course, with the employing institution, the 
field of specialization, and the personality and abilities of 
the individual. Dismaying enough it is to find that the 
technical schools and teachers colleges list almost none of 
these doctors as researchers. Making a liberal allowance 
for research as a supplementary occupation to one of major 
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concern, it would still be clear that research is not the occu- 
pational goal of any large portion of the men and women 
who receive doctorates from American universities. 

The bearing of these data upon the objectives and admin- 
istration of graduate schools is a matter that may claim 
some attention from these training institutions, and, as well, 
from those other institutions which consume their products. 
There is a widespread conception of the graduate school as 
an agency for the promotion of research and the training of 
research workers. The almost universal requirement of the 
research thesis and the evidence of capacity for productive 
scholarship as prerequisites for the doctorate is testimony 
to the general devotion to this ideal. 

If research were to be regarded as the exclusive aim of the 
graduate school or even as its primary objective, the present 
occupation of its graduates would seem eloquent testimony 
to its failure to achieve its intention. Either the market 
for researchers is too limited to absorb the ever increasing 
output, or the quality of the men at the end of training is 
inadequate to prevent wholesale abortion of good intentions. 
One may have his choice of explanations, but the evidence 
is clear that American graduate schools are not confined to 
the production of research workers. Primarily they are 
doing other things. This finding is in line with widely held 
opinion, and is supported by every study of the problem 
which has been made. Jernegan from his recent study® of 
the productivity of history doctorates infers that about 25 
per cent are productive after receiving the doctorate. The 
other 75 per cent are teachers only or are engaged in non- 
educational work. 

Since these data have an important relevancy to the char- 
acter of American college and university faculties they may 
be related to the results of a recent investigation reported 
(1928) by a committee* of the North Central Association. 


5 Jernegan, M. W.: “Productivity of Doctors of Philosophy in 
History.’’ American Hist. Rev., 33: 1-22, 1927. 


* Committee on Faculty Training. President Charles Henry Ram- 
melkamp, Chairman. 
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This study gives the facts for one hundred sixty-three col- 
leges and universities having 8,743 faculty members. Of 
this total, 2,968, or 33.9 per cent, have the doctor’s degree. 
Five thousand seven hundred seventy-five, or 66.1 per cent, 
have less training, 58.1 per cent have no more than a master’s 
degree, and 24.8 per cent only a bachelor’s degree. For 
twenty-three representative universities and thirty-five rep- 
resentative colleges the figures are slightly higher—72.4 per 
cent of doctors for the universities and 49.8 per cent for 
the colleges. 

If research as a major interest claims so meager a portion 
of the doctors as our study shows, then it is clear that in 
faculties claiming so small a fraction of doctors the business 
of research is all but negligible. The truth is that these 
faculties are teaching faculties engaged with students who 
are too immature for the business of investigation, and with 
bodies of information that are far short of the frontiers of 
knowledge. It is also true that almost without exception 
these faculties have had no training for research in the ac- 
tivity which claims all but a fraction of their time and energy, 
namely, in the problems of education. While some of them 
are sufficiently trained to conduct research in the subject 
matter of their choice, if the conditions of their employment 
encouraged such activity, they are wholly without technical 
skills or the essential attitudes for investigation in the main 
occupation of their lives. They produce nothing of value 
in subject-matter fields because either the esential initiative 
or the conditions are lacking. They add nothing to our 
knowledge of education because they have never learned 
how to do it. 

It is clear from an examination of the data that the occu- 
pation which exceeds all others is teaching, primarily college 
and university teaching. Interestingly enough, the data 
show that the doctors from private universities are predom- 
inantly to be found in private colleges and universities, and 
those from state universities are in public colleges and uni- 
versities. About sixty per cent (not including the Hopkins 
data) of all individuals are engaged in college and university 
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teaching and administration, and an additional six per cent 
are teaching in other types of schools. 

In view of the fact that teaching is the predominant occu- 
pational destination of Ph.D. recipients, it is pertinent to 
inquire what tie graduate schools are doing to prepare stu- 
dents for their future business. The present study provides 
no material answer to this query, bui in the study already 
noted’ it appeared that their efforts are confined to two 
things: the exploitation of subject matter with the techniques 
of scholarship relevant thereto, and some form of apprentice 
teaching. Practically nothing is done by way of specific 
instruction for the business of college teaching, and there is 
evidence of hostility on the part of some graduate schools 
to such instruction. The reasons usually given for failure 
to require or even to offer such instruction are lack of time 
on the part of the student, the absence of need for such in- 
struction, or the inconsequential character of what students 
of education can offer to the aspiring doctor. 

To the host of college instructors that engage in this enter- 
prise the American graduate schools add an army of young 
doctors each year.* Does this increment of teaching per- 
sonnel add anything of professional equipment of college 
faculties? Apparently not. 

The writer has no intention of debating this issue in the 
present paper beyond calling attention to certain easily 
understood facts. In about four hundred American colleges 
and universities attempts are being made this year to im- 
prove the education provided for students.* In the main 
these attempts center about four problems, the curriculum, 
methods of teaching, organization and administration, and the 
abilities and interests of students. It is fair to say that for 


7 Haggerty, M. E.: ‘‘ The Professional Training of College Teachers.’’ 
North Central Association Quarterly, Vol. II, p. 108 ff. 

® Hull, Callie, and West, Clarence J.: ‘Doctorates Conferred in 
Science by American Universities.” 
WOO veuivees s17 BSB BP DBD HBB Sa BS SS 
PeDstecswedcue 373 293 180 328 334 454 575 609 631 740 


* Unpublished study of the North Central Association Committee 
on Professional Training. 
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the most part the persons who are attempting these im- 
provements have had no specific training for the work they 
are undertaking other than that gained in the graduate 
schools. This, with native ability and ‘‘experience”’ makes 
the total equipment of these would-be-improvers of American 
education. Their psychology, generally gained at second 
hand, is usually more popular than profound, and they are 
curiously free from any belief that there are ‘‘principles”’ of 
curriculum construction. 

It may fairly be asked whether the time has not arrived 
to face squarely the obvious facts. The graduate schools of 
American universities are essentially teacher training insti- 
tutions and upon the kind of training which they offer and 
require of their doctorate candidates will depend the char- 
acter of our college faculties and the quality of college edu- 
cation. Is it too much to ask that in this program of grad- 
uate training the student should be required to give some 
attention to the problems of education—problems which will 
constitute the student’s chief concern once he is launched 
on his professional career? 

M. E. Haccerry. 
Umiversity of Minnesota. 








Federal Legislation’ 


VIATION rather than legislation has changed the 
Arena for educators the past year. Geography has at 
last become spectacular. Maps of the Atlantic, of the 
Caribbean and of the North Pole have been taken out of 
the geography books and spread on the front pages of the 
newspapers. Distances interpreted in hours of airplane 
travel, have for the first time, a denominator common alike 
to land and sea, plain and mountain. Even the dullest 
school boy begins to feel that he possesses his world because 
he has throbbed across it with Lindbergh and viewed it at 
first hand with Fitzmaurice. To take the wings of the 
morning and fly to the uttermost parts of the earth is no 
longer reserved for the imagniation of the poet; it is the 
commonplace thought of the slowest man on the street. 
The speedometer has replaced the yardstick. The theater, 
so much more responsive to the thought of the day than our 
representative assemblies, is full of references to the new 
standard, with the recurring complaint, “these aviators are 
making it hard for the rest of us; sons expect so much more 
of their fathers, and girls so much more of their suitors, in 
the way of speed and daring.”’ 

To a world of this mind, the slow grinding of the wheels 
of legislation is a bore. Even Lindbergh’s heroic attempt 
to quicken the heart beats of congressmen by free airplane 
rides did not greatly alter the rhythm. The legislative 
machine appears not only not heavier than air; it has no 
internal-combustion engine of its own, sufficient to give it 
motion and direction among contending winds. It is com- 
ing more and more to conceive itself as a balloon, whose 
function it is to move only as, and when, the wind of popular 
interest blows. It feels it cannot choose its port or modify 
its speed. Ask any senator or congressman why there is no 


1 Report of the Committee on Federal Legislation presented at the 
annual meeting of the American Council on Education, May 5, 1928. 
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action on this or that measure and the answer will be, ‘‘ There 
is no popular demand. We do only those things we are 
compelled to do by pressure from without.’’ It is a mistake 
to think of Congress as an aeroplane. You should think 
of it as a balloon. To understand movements in Wash- 
ington, you must direct your attention, as the weather man 
does, to the Highs and Lows out toward the Rockies or the 
air currents along the Mississippi. 

The Council printed in the January record a list of the 
more important bills affecting education. I will not take 
your time to mention them here. Since January some have 
been added to the list which I shall speak of hereafter. 

The optimistic opinion expressed in the Record that the 
Curtis-Reed bill (S 1584-H.R. 7) to create a Department of 
Education would receive more attention in the present 
session than it did during the Sixty-Ninth Congress has 
proved a delusion. 

With Governor Smith looming up as Democratic nominee 
for President, all political questions on which the Catholic 
Church or Anti-Catholic Church organizations have taken 
a definite stand are taboo for public discussion. Neither 
Republicans nor Democrats want to “wake the baby,” 
and the cry is Hush! Hush! The parties would have liked 
to see the same policy prevail in the case of that other lusty 
baby ‘“‘Prohibition,’’ but it looks as if McAdoo for the Dem- 
ocrats and Butler for the Republicans had irremediably 
wakened that baby, so that is must be considered in any 
plans the parties make for a pleasant evening. 

The friends of a Department of Education, on the other 
hand, have from the first tried to avoid raising the question 
of Church and State in Education. They do not think it is 
a question so easily solved as Mussolini seems to think in 
his offhand judgment of Solomon, by saying to the Church, 
“You take and educate the spirit, and I will educate body 
and mind.”’ The hope still prevails in this country that it 
will be possible in the future, as in the past, for the two sys- 
tems, both authorized by the state, tax supported and vol- 
untary, to continue side by side and provoke one another 
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to good works. For this reason the friends of a department 
would prefer, when the department comes, that it should 
come as the department of all educational enterprise, not 
as the department of one faction which has won in a fac- 
tional strife. They have tried, therefore, to avoid joining 
issue with that alignment of forces. It would be well if our 
Catholic friends would also see, as the wisest and most far- 
sighted among them do, that they have even more at stake 
in this policy than the state systems have. For as surely 
as they carry their opposition to the point of attempting 
to frustrate the legitimate aspirations of American educa- 
tion as a whole, they will antagonize state education to a 
point that may endanger the very existence of parochial and 
voluntary education. 

The baby may sleep through the noise of a presidential 
campaign, but it is doubtful. Already it has been necessary, 
I am told, to ask Mr. Hoover where he stood on the question 
of a Department of Education, as Senator Borah asked on 
the prohibition question, and to secure the recall of campaign 
material prepared in Mr. Hoover’s name by his over-zealous 
friends. If Governor Smith should be nominated, I suspect 
that his friends will have cause to regret that the baby was 
not waked earlier, for sleeping babies have a way of growing 
overnight into uncontrollable lads. 

Hearings on the bill were held by the House Committee, 
April 25, 26 and 27. The Council was represented by Dr. 
Mann, Dr. Judd, and the chairman of this committee. The 
testimony will be printed later at government expense and 
will be available for all. 

The Committee of the House has been increased in mem- 
bership from 15 to 21. It is perhaps significant that the 
new members bring the number of adherents of the Catholic 
Church on the committee up to five, which indicates an 
interest in public education among the Catholic members 
of the House somewhat out of proportion to the total number 
in the House membership, though the ratio of 5 to 16 is not 
perhaps excessive with reference to the total population of 
the United States. 
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While the bill for a department does not seem to be making 
great progress, it has had the curious effect of stirring those 
who are opposed to it, to show, by increased appropriations 
to the present educational offices, that the purposes of a 
department can be otherwise accomplished. 

Thus the last Congress appropriated $117,000 to the 
bureau to conduct a survey of the Land Grant Colleges, and 
Senator Phipps has introduced a bill (S. 1273) authorizing 
an increased appropriation of $250,000 to the bureau for 
certain studies. Taking advantage of this attitude, Dr. 
Mann has prepared a bill which would authorize an appro- 
priation of $500,000 to the Bureau of Education for a ‘“Two- 
year study of the present organization, administration, fi- 
nancing and work of public secondary schools of all types 
and of the articulations among them and colleges and normal 
schools. ’’ 

The Senate has passed and the House Committee on 
Education has formally reported and asked for a vote, on a 
bill authorizing an additional appropriation to the Federal 
Board for Vocational Education, which will eventually 
amount to $6,000,000 additional annually to be paid to the 
states on the fifty-fifty basis to extend instruction in state 
schools in agriculture, in industrial trades and in home 
economics. The bill was introduced with the recorded ap- 
proval of Secretaries Hoover, Jardine and Davis, although 
declared by the Bureau of the Budget to contravene the 
policy of the administration and although obviously in direct 
conflict with Mr. Coolidge’s message warning against the 
dangers of the extension of the fifty-fifty subsidy system. 
A further bill, H. R. 12691, has been introduced by Mr. 
Oldfield, which would extend the field of operations to inde- 
pendent high schools and academies and authorize a $500,- 
000 additional appropriation for the purpose. 

A bill H. R. 10297 has been passed authorizing the in- 
crease by $1,440,000 annually of the appropriation to the 
Department of Agriculture for cooperative extension work 
in agriculture and home economics, for men, women, boys 
and girls, at least 80 per cent of the money to be used for 
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the salaries of county extension agents. The line between 
the educational work of the Vocational Board and the edu- 
cational work of the Department of Agriculture seems to 
be that, while both may encourage and direct the work of 
children in the fields, the instruction given by the Vocational 
Board must form a part of a school curriculum. 

Still another department has been asked to take a hand 
in education by H. R. 11274, introduced by Mr. McSwain, 
which provides that the Postmaster General shall furnish 
to the chief educational administrative officers of the several 
states or territories sufficient stamped envelopes, without 
expense to the states, to care for all the official correspondence 
of the educational administrative officers of the states, and 
of the subdivisions of the states. 

There has been introduced by Mr. Berger a bill (H. R. 
10155) authorizing the appropriation of $2,000,000 annually 
for five years to the Bureau of Education for the purpose of 
cooperating with the states on the fifty-fifty basis to combat 
illiteracy. 

There has been introduced by Mr. Zihlman a bill (H. R. 
12140) to increase the allowance, under the Land Grant Act 
of 1867 to the University of Maryland, $50,000 a year to 
compensate them for the instruction given residents of the 
District of Columbia. 

A bill (S. 2450) introduced by Senator Reed and spon- 
sored particularly by the Women’s Colleges, together with 
Harvard, Minnesota, Michigan and Yale, has been passed 
by the Senate the effect of which would be to abolish the 
requirement that in order to be eligible for admission as a 
teacher under the non-quota law the applicant must have 
taught for two years in a foreign country next preceding 
the application, and to substitute therefor the evidence of 
an actual contract with an American college, academy, sem- 
inary or university approved by the Secretary of Labor. 
The greater elasticity seems desirable, but the fact that 
the bill was referred only to the Committee on Immigration 
and not to the Committee on Education, and that it places 
the matter of contracts with foreign teachers entirely in the 
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hands of the Department of Labor, is another illustration 
of how the Federal Government, reluctant to create a De- 
partment of Education, goes haphazardly along calling 
upon the Secretaries of War, Navy and the Interior, the 
Postmaster General, the Secretaries of Agriculture, Com- 
merce and Labor, Boards, Bureaus, Councils and Commit- 
tees, each in turn to lend a hand as Secretary of Education 
pro tem or ad hoc, and so render confusion worse confounded. 
Perhaps all this but illustrates the truth of John Dewey’s 
words in his recent address, ‘‘ Education is the most complex, 
intricate and subtle of all human enterprises.’’ But Dewey 
encourages us to hope for better things by adding: ‘‘The 
idea that education is a field of study, observaton, experi- 
ment, and inquiry has been already demonstrated. It re- 
mains not only to continue the development of all the special 
investigations incident to this fact, but to bring the public 
to the appreciation of its full significance, to make its force 
felt in every aspect and phase of educational endeavor.”’ 
Joun H. MacCracken, 
Chairman. 














A Study of Examinations in 
Graduate Courses in Education 


HIS study is concerned with a statistical and critical 
survey of the course examinations given during the 
first six years of the Graduate School of Education of 
Harvard University. It is a fair assumption that the teach- 
ers in a school of education will possess exceptional clarity of 
aim in the setting of examinations, and will exemplify such 
superiority of method as will prove helpful to teachers in 
other departments and other institutions. What, then, are 
the characteristics of the examinations written by the in- 
structors in this school, and what may be learned from a 
study of them? 

The Place and Value of Examinations.—From the stand- 
point of the instructor the final examination is at one and 
the same time a necessary part of the education of the stu- 
dent, and a convenient tool for measuring his ability in the 
course. From the standpoint of the student the examina- 
tion and the preparation therefor give him the opportunity, 
first, to organize the subject matter and the method of the 
course into a body of thought which seems to him coherent 
and related to his mental world; second, to think systemati- 
cally about the application of the principles of the course 
to his own cultural and professional needs; and third, to 
practice, during the examination itself, the recording of 
productive thought on important topics in the field of study. 
Not infrequently students in the School of Education have 
later made effective professional use of ideas which have un- 
folded to them during the period of an examination. 

Relation of Examinations to Courses.—The naive view of 
an examination is that the professor, having planned and 
delivered his course, writes at the end thereof an examina- 
tion based on the course. Doubtless this view is too easy 
an explanation. Historically, examinations often preceded 
and led to lectures, instead of the reverse. The magazine 
Punch expresses the intimacy of the relationship, but pro- 
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fesses doubt on causation: “‘Having touched upon the ques- 
tion of Military Lectures it is essential that I should deal 
with Military Examinations, for the one would be of no 
consequence without the other. Indeed it is questionable 
which were introduced first, which are the cause and which 
the effect, which the hen and which the egg.” One uni- 
versity president showed no hesitation in stating that the 
examination is important because it determines what shall 
be put into the course! 

Whatever may be the truth in the courses given and the 
examinations set by the reader of this report, the students’ 
measure of the course is very likely to be the examination. 
He knows that “‘the examination counts,’’ and he definitely 
prepares for it. 

Other Measures.—But do instructors count so much on the 
examination? About half of the final mark, it appears, is 
built up from the result of the final examination; this seems 
to be the general practice at the Harvard School of Educa- 
tion. What are the other measures that weigh in the scale? 
Following are the replies of instructors to a questionnaire 
relating to the other measures of student ability: 


MEASURES OF ABILITY, IN ADDITION TO FINAL 
EXAMINATIONS 


Note: All ‘‘systematic’’ or expository courses use the final examina- 
tion; only those are included in this study, seminary and individual 
research courses being omitted. Figures in this table indicate the 
number of instructors reporting each item, counting only once courses 
given after identical methods by the same instructor. 


Hour examinations during the course: one examination, 10; two ex- 
aminations, 2. 

Shorter tests, 1 (four tests). 

Of these examinations some are ‘‘new form”’ (see below): on the sub- 
ject-matter of the course, 5; on required readings, 4; on application 
of the course, 2. 

A long thesis, 14. 

Several short papers, 14 (about three as an average). 

Reports on school visits, 4. 

Preparation of bibliography, 3. 

Outline or brief, 4. 

Conferences, 13. 
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Oral quizzes, 4. 

Discussion, 16. 

How the required reading is checked: cards or reviews handed in, 6; 
class examinations, 2; class discussions, 5; inspection of notes, 2; 
questions in final examination, 12. 

When the ‘‘new form” is used as part of final examination, what part 
of the total examination mark depends on it? About one-third, 2; 
about two-thirds, 1; all, 1. 

What fraction of the student’s mark in the course is derived from his 
mark in the final examination? About one-fourth, 2; about one- 
third, 3; about one-half, 8. 

On the last question, naturally enough, exact fractions 
seem objectionable. One instructor states that, though it 
is probably heresy for a teacher of statistics not to be math- 
ematical in making up his grades, he does not follow any 
plan of weighting parts of the work. With four or five 
marks for each individual in his record book, and with much 
acquaintance with individuals, he decides what grade best 
represents the level of the individual’s efforts. A second 
instructor states perhaps the usual policy: “‘ My final rating 
is an expression of a generalized judgment into which enter 
(1) personal estimates of seriousness, ability, application, 
etc., derived from personal contacts in class, conference, 
and casually; (2) thesis; (3) reports on readings; and (4) 
final examination.” 

To the above list of measures should now be added reports 
on and discussion of cases and problems, which is assuming 
a larger share of attention in several classes. 

The Number of Questions in Each Examination.—Resource- 
fulness is a major quality needed by the student who takes 
an examination. One student was much confused when he 
found himself required to answer seventeen questions when 
he had expected five or six. Yet the test with seventeen, 
at least if the character of the questions be the same, is likely 
to be the fairer one. Much philosophizing might use this 
problem of the right number of questions as its starting 
point, but we shall give the facts and leave their interpre- 
tation to the reader. Following are the figures for the ap- 
proximately two hundred examinations given in the school 
during its first six years, not counting summer schools intruc- 
tion, and omitting new form examinations. 
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NUMBER OF QUESTIONS IN EACH EXAMINATION 
Read the first line of this table as follows: A total of seven examina- 
tions contained only one question each: Two of these were in the third 
year, two in the fifth year, and three in the sixth year. 


Number of Questions Number of Examinations 
Total Yr.1 2 3 4 5 6 
i i ie hi cM < Seis gti 7 2 0 2 3 
dee eis ahs ers cerca dee 5 1 1 1 1 1 0 
ES Sars og val oh iw Wao He ao 12 3 0 4 3 0 2 
See, eee Oe 25 1 3 4 6 7 4 
BS toss of nk cde ew bere 29 3 8 3 6 3 6 
SEE cee Fare eee 35 8 8 7 5 5 2 
Ee eee 21 2 0 2 4 5 & 
Ee ee See ae 30 6 3 5 7 5 4 
ET eae Ue On sty care hale ee 7 2 1 2 2 
_ RE Se ee ree 18 8 3 6 1 
I ed os bole i aloe hoa ee Bi 2 2 0 0 
a en eee + 1 1 1 1 
SES cot Stowe. cla y 2 1 1 
Ro. once ve camden 1 1 


The average number will be found to be close to six, but 
the spread in the later years is noticeable. Following is a 
more compact table using the same data: 


Number of Questions Number of Examinations 

Total Yr.1 2 3 6 
ee 12 1 1 3 1 3 3 
Tries OF BUF... cee 37 4 3 8 9 7 6 
Es a dari s «ap «kha 64 11 16 10 «Ii 8 8 
Seven or eight.............. 51 8 3 a. o — 
DTN Oh bike bec 8s wees 25 0 10 4 8 3 
Eleven or twelve............ 6 1 0 3 1 1 
a ee : ee ee 1 2 


Do the Examinations Give Students a Choice of Questions? 
—In the case of about one examination out of four, the in- 
structor allowed the students to select for answer certain 
questions from a larger list. Often only one question could 
be left out; rarely three or four could be selected from a list 
of ten or more. Perhaps the typical case allowed six ques- 
tions to be answered out of eight or nine given. 

It will be noted that the instructors in certain fields of 
education never allow choice in their examinations, and that 
in one field almost all examinations allow choice. Fields 
differ, and in some the lines of application of the work of 
the course, as well as ramifications of interest, especially for 
experienced students, suggest differentiation appropriately 
reflected in the choice of questions in the examination. 
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It should be stated at this point that the School of Educa- 
tion has designated the different parts of its work or fields 
of study as follows: Philosophy of Education; Educational 
Psychology; History of Education; Educational Administra- 
tion; Elementary Education; Secondary Education; Edu- 
cational Measurement and Statistics; Vocational Education; 
Vocational and Educational Guidance; Play, Recreation and 
Physical Education; The Teaching of School Subjects. For 


these we use convenient abbreviations in the tables that 
follow. 


NUMBER OF EXAMINATIONS ALLOWING A CHOICE OF 
QUESTIONS, BY FIELDS OF STUDY AND BY YEARS 


Read the first line of this table as follows: a total of 23 examinations 
were given in the field of Philosophy of Education, and 10 of these 23 
examinations, or 43 per cent, allowed a choice of questions. In the 
first year a total of two examinations was given, one of which allowed 
a choice. For the full names of other fields of study see the paragraph 
next above. Only the third column is in percentages. 


All Years Yr. 1 2 3 4 5 6 

Tt. h%ATOC TOTO Or. UT. CC. 
Phil.. . 2 2 ass Se oe ee Be eee 
eo es S ¢um ecuegctpte4t &. eS Se 
Hist... ;, 4 tee 2 6 66 tt Ce 
Admin. a 6mm 3.8 Pe © @ & £4 2 ees 
Elem.. 1913 72% 22112243 42 «5 3 
> empaelaas = +vme646e8e its 86 Ft 8 FS 
Mens... 00% 0 02010101 06 2 «0 
Voc. Ba... ||: 19 §$ 206% 2222405065 01 1 
bette 312 92% 22223 22222 2~O2 
gta 2 0 0% 20408 05 030 6 0 
Teach......... 313 0 O*% 103060370707 «8 
Totals........ 212 56 26% 23 9 27 8 36 7 43 11 38 7 45 14 


There is a year to year variation in these figures for which 
I have found no explanation; it cannot be said that there is 
any distinct tendency, except the tendency to variation. 
The curve ends about as it began. The third and fifth 
years seem to be the strictest years, with instructors in over 
half the fields denying any choice of questions. 

The Character of the Examination Questions.—We shall now 
study more intimately the questions themselves. An inves- 
tigation seems appropriate to discover just what they at- 
tempt to do. What kind or kinds of ability are they ex- 
pected to test? What kind of knowledge are they supposed 
to elicit? Does the instructor wish to have reproduced the 
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facts and principles of the course; does he wish application, 
criticism, constructive exposition, definition, or ratiocina- 
tion? Or what combination of abilities has he in mind as 
he writes the examination? 

The writer realizes to the full that he is here upon slippery 
ground. How can we tell, in the case of a given question, 
what ability is required to answer it? Much depends upon 
the particular answer and the particular answerer. And 
are mental abilities separate things, as our act of classifica- 
tion seems to assume? Notwithstanding these and other 
patent and hidden objections and difficulties, there inheres 
one value in a study of types of questions; namely, a closer 
scrutiny of educational aims, which in turn should lead to an 
increasing clarity of purpose in the preparation of examina- 
tions. The desired result and the interest of the task seem 
sufficient to make one assume the risks involved. 

Careful study of the more than fourteen hundred ques- 
tions revealed three main bases of preliminary classification, 
as follows: (A) Questions concerned chiefly with memory 
and recalling; (B) Questions relating to reasoning, exposi- 
tion, discussion, or argument; (C) Questions requiring use 
in application or original work. Again, under each of these 
main classifications there appeared to be sub-topics discern- 
ible; finally, eleven different groupings were developed for 
use in thisreport. They are given herewith, with illustrative 
examination questions under each. 


CLASSIFICATION OF QUESTIONS INTO CATEGORIES USED 
IN THIS REPORT 


A. Questions Concerned Chiefly with Memory and Recalling 

1. Reproducing facts and principles; e.g., State the chief psy- 
chological principles which a teacher of modern languages 
should have constantly in mind while teaching. 

2. Defining; e.g., What is a child? Make a brief but compre- 
hensive statement of each of at least three different con- 
ceptions of the mind of a child. 

3. Questions on the required reading; e.g., Make a list of five 
books that give especially helpful suggestions on the teach- 
ing of English in the high school. Offer a sentence or two 
of terse comment upon each. Omit mention of the basic 
text. 
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B. Questions Relating to Reasoning, Exposition, Discussion, or Argu- 
ment 

4, Explaining, describing, or drawing conclusions; e.g., In what 
ways has so-called ‘‘General Science”’ met the needs of the 
first-year students in high school? In what ways has it 
failed? 

5. Analyzing into principles, steps, or factors, e.g., Is the differ- 
entiation in the doll-play of boys and girls due to “original 
nature” or to “learning?” State the grounds of your 
answer. 

6. Judging a policy or procedure; e.g., A high school curriculum 
requires eleven of its seventeen units in the languages, four 
of which are English, and the other seven Latin and French. 
Discuss this arrangement from the following standpoints: 
historical, cultural, practical, college preparatory. 

7. Criticizing a statement; e.g., ‘‘The corporation school finds 
its chief réle in teaching the detailed technique of particular 
businesses. . . . Instruction in technique can be given by 
the corporation school at less social cost than otherwise, 
because it rids other institutions (public schools) of a bur- 
den too long assumed.’ Comment on the above quotation 
in such a way as to reflect the point of view of the course. 

8. Comparing two or three points of view; e.g., “‘Competitive 
tests in typewriting and shorthand are useless."’ ‘‘Noth- 
ing has done more to improve instruction in typewriting 
than the tests fostered by the typewriter companies.” 
These statements indicate points of view on the general 
subject of competitive tests. State your position with 
reference to this matter in such a way as to be genuinely 
helpful to a superintendent of schools or to a beginning 
teacher of the two subjects involved. 

C. Questions Requiring Use in Application or Original Work 

9. Applying a principle; e.g., Show how the principles of the 
relations of lay boards of control to professional workers 
will determine the qualifications of members of boards of 
education and their duties. 

10. Constructing a plan; e.g., Describe the procedure which you 
would adopt if you were made director of an intelligence 
survey of a school system in a town in which no one had 
heard of the I1.Q. Show how and by whom the results 
would be interpreted and used. 

11. Solving a problem or case; e.g., Suppose yourself confronted 
by the problem of taking charge at the beginning of the 
second half-year of a sophomore class in your subject, 
comprising about thirty boys and girls. About one-third 
of the pupils are preparing for college; the others will leave 
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school either at graduation or before the completion of 
their high-school course. The appearance of the class 
would indicate a wide range of individual differences both 
in ability and in social inheritance. 

The previous teacher has conducted the work by the 
study-recitation method, using textbooks intended directly 
for college preparation, and adhering closely to a formal 
course of study prescribed for the school system. She 
has relied chiefly upon direct methods of control. Though 
the class average of accomplishment is about normal for 
the grade, a study of the mid-year examination papers with 
which the principal provides you reveals a wide range of 
achievement, with certain of the college-preparatory stu 
dents ranking very low. 

Exactly how do you plan to deal with the situation? 

When the application of this list of categories to the ex- 
amination questions showed several which should be listed 
under two heads, this policy was followed. The statistical 
results are given in the four tables next following, the first 
two tables relating to the several categories or kinds of 
questions distributed by years, and the second two tables 
relating to the categories distributed by fields of study in 
the school. We have not included detailed figures showing 
differences in the several fields by years, nor those relating 
to specific courses within the several fields. 

Distribution of Questions by Years.—First, then, how often 
were the various kinds of questions used throughout the 
first six years of the School of Education? Our first table 
gives the numbers; the second the percentages. 


NUMBER OF QUESTIONS UNDER EACH CATEGORY, 
BY YEARS! 


Note: See the explanation of the classification categories above. 
Read the second column as follows: In the first year 23 questions in 
final examinations called for memory of facts, 6 for definitions, etc. 





1Jf the reader should note discrepancies among the totals given in 
the various tables of this report, it may be said that there was some 
difficulty with the question of including certain examinations which 
seemed not to fit into the plan of the investigation, such for instance, 
as those given by visiting instructors. For some tables these are in- 
cluded, for others they are omitted, all without significance in the final 
results. 
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Recalling: Total Yr.1 2 3 4 5 6 
EE Ce ae 203 23 &’ 2a &. Ae Bt 
NR io 0 oa aint Be sie 41 6 1 7 10 oe 
ED, «0b Sascccsebers 97 8 i ie ee 

Reasoning: 

Oe ee 248 40 32 55 27 48 46 
Ds kedncceteewad 20 Hi So DBP Ss SBS 8 
FuRGMERE...... 2... ceceees im ©. &@ 3B ito ue 
NS oo a tn. wip oleae 73 7 ee oe oe 
Comparison............. 34 8 4 2 9 6 5 
Using: 
Application. ............ 83 19 . 2 ee ee 
Construction. ........... 7%6¢0cC<i<C<C wWWC(‘( HCC! CL CSC Cm CUMLUmGDUCD 
OO Serer re 81 8 11 19 16 15 12 
vg ac oi 665 1437 189 176 249 302 275 246 


Recalling: All Yr.1 2 3 ae 5 6 
ee 14 13 , =e m/s 
DS tncnscadcanews 3 3 1 3 3 2 4 
DE aetnh ohcvcesaeen 7 4 4 9 6 8 8 

Reasoning: 

EOD. os oS vec ecens Tee @ 9 17 19 
Ns 05> <0 ceans ce ven so 2 7 Ea aS 
I, oti cickscapacede 8 8 9 8 7 6.8 
Ee Ors s- 5 2 8 6 + 5 6 
eo Pee 2 4 2 1 3 2 2 

Using: 

Application. ...... 6 10 1 10 3 5 6 
oO 13 > «Se 
TL Per re eee 6 4 6 8 5 5 5 


It will be observed that almost two-thirds of the questions 
are included under four out of the eleven categories, these 
four being facts, explanation, analysis, and construction of 
aplan. These four hold their importance fairly consistently 
year by year, in spite of many variations among the several 
items. Only definition and comparison (which is perhaps 
only a double form of criticism) are under 5 per cent. The 
obvious lesson of these figures for the student is to be pre- 
pared for all the various tasks suggested by these categories. 
Let him merely combine the final figures into the three 
major groups indicated above, to see that all abilities are 
needed: Memory, 24 per cent; Reasoning, 51 per cent; and 
Use, 25 per cent. 


Distribution of Questions by Fields of Study.—The next 
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matter of interest is to see how the several kinds of questions 
were called into use by the instructors in the various fields 
of study in the school, and to compare the figures for these 
fields. It should here be noted that no single instructor 
or even a well-defined group of instructors is represented 
by the figures in any field. Throughout these six years 
there were many changes of personnel; even specific courses 
within a field of study were seldom given by the same in- 
structor throughout. 


NUMBER OF QUESTIONS UNDER EACH CATEGORY, 
BY FIELDS OF STUDY 


Note: See the explanations of the several categories and fields of 
study above. Read the second column as follows: In the field of 
philosophy of education 8 questions in final examinations called for 
memory of facts, 6 for definitions, etc. 


Total Phi. Psy. His. Adm. Ele, Sec. Mea. VE. VG. Pl. Teach. 


Recalling: 
ee 207 8 20 44 10 22 10 5 il 43D 
Definition. .... 41 6 7 0 0 7 4 3 5 0 7 2 
Reading....... 95 19 + 0 4 15 6 4 13 i 12 17 
Reasoning: 
Explanation 259 25 37 3 11 40 30 9 26 24 23 31 
Analysis........ 265 21 20 2 18 31 42 7 38 28 27 31 
Judgment —™ 131 14 7 1 9 13 16 2 32 10 10 17 
Criticism... 74 15 2 0 3 10 9 2 17 6 4 6 
Comparison 34 3 2 3 3 6 3 2 4 3 2 3 
sing: 
Application. 87 8 9 0 10 12 2 6 8 13 8 il 
Constructon 183 7 21 0 1 il 30 2 23 31 25 32 
Solving....... 81 7 15 0 0 3 9 15 4 10 9 9 
2 ee 1457 133 144 53 69 170 161 57 181 130 166 193 


PERCENTAGE OF QUESTIONS UNDER EACH CATEGORY, 
BY FIELDS OF STUDY 


All Phi. Psy, His. Adm. Ele. Sec. Mea. VE. VG. Pl. Teach. 
i iewds<<s 4 6 14 82 14 13 
5 


6 9 6 3 24 18 
Definition... .. 3 5 0 0 4 2 5 3 0 4 1 
| ae 7 14 3 0 6 9 4 7 7 1 7 ov) 
Reasoning: 
Explanation... 18 19 26 6 16 23 19 16 14 18 14 16 
Analysis....... 18 16 14 4 26 18 26 12 21 22 16 16 
Judgment cess 9 il 5 2 13 8 10 4 18 8 6 9 
Criticism...... 5 il 1 0 4 6 6 4 Q 5 2 3 
Comparison . 2 2 1 6 4 + 2 4 2 2 1 2 
Using: 
Application.... 6 6 6 O 14 7 1 it 4 10 5 5 
Construction .. 13 5 15 0 1 6 19 4 13 24 15 17 
Pee 6 5 10 0 0 2 6 26 2 18 5 5 


Differences in Specific Courses.—-The kinds of questions 
used in different courses vary markedly. Consider two 
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courses in the field of educational psychology. In one 
course a great variety of questions was used, drawn from 
ten of our eleven categories. In another only six kinds were 
used. In one course in the field of the philosophy of educa- 
tion over 40 per cent of the 37 questions in six examinations 
have to do with the applications of the course; in another, 
only two per cent of the 49 questions. In one course on 
teaching methods 27 per cent of the questions relate to 
reasoning; in another 49 per cent. We shall comment later 
on the factual nature of the questions in the examinations in 
the history of education. 

Combinations in specific examinations we have not studied, 
nor do we maintain that every examination should draw 
from several kinds of questions. That depends on the pur- 
pose of the course and of the examination. But a consider- 
ation of the various possibilities, at least through a back- 
ward glance at one’s examination after it has been written, 
might not be amiss. 

The Use of “‘New Form" Examinations.—Fifteen of the 
approximately two hundred examinations used the so-called 
“new form’’ or “objective” examination, and one of these 
was wholly of this form. The advantages of such examina- 
tions in the form of true-false alternatives, multiple choice, 
filling blanks, and the like are obvious, but the limitations 
appear to make them ill-adapted for comprehensive testing, 
if, indeed, that be the purpose of examinations. They are 
admirable for testing the student’s memory of the facts and 
point of view of the course, but they can hardly test appli- 
cation or constructive and original abilities. Some instruc- 
tors habitually give a half-hour true-false test on the subject 
matter of the course during one of the last few meetings, 
thus freeing the time of the final examination for more com- 
prehensive testing. When fundamental issues of difficulty 
are presented in the course, the new form examination treads 
on dangerous ground if it uses these issues as test material. 
I have before me a true-false examination prepared by a 
mature student of vocational guidance. In a majority of 
cases, his statements raise issues so large, and the particular 
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circumstances would alter the cases so markedly, that no 
safe yes or no is possible. Furthermore, it has been found 
that the better student often penetrates into these multiple 
relationships, ponders, and, out of his own particularized 
original thought or experiences, answers in the way the in- 
structor did not intend, while his more superficial classmate 
wins the higher score. The temptation consequently is 
strong, in objective examinations, to secure objectivity by 
avoiding statements presenting real issues and statements 
requiring the use of reasoning. Thus one such examination 
presents 83 blanks to be filled, and yields itself to the follow- 
ing analysis: definitions 31, reproducing facts 47, questions 
on the reading of the course 5. Further experiment on the 
graduate level, with mature students, is needed. 

Questions on History.—Twenty-eight of the one hundred 
eighty examinations outside the specific field of history of 
education contained questions on the past. Three of these 
examinations each contained two historical questions; the 
other 25 contained but one each. Thus only 31 questions 
out of about 1,400 (omitting from consideration the exami- 
nations in the specific field of history) dealt with questions 
on history. Moreover, the questions in that specific field 
“history of education,”’ as will be seen by reference to the 
tables, lie largely in the field of memory rather than reason- 
ing or use. Out of 53 questions in eight examinations none 
were concerned with use, nine with reasoning, and 44 with 
memory.? Obviously, important educational issues are here 


2Since preparing this article the writer has satisfied himself 
that the implied criticism does not apply to the courses given in 
the Harvard Graduate School of Education. Professor A. O. Norton 
of Wellesley College, who has given most of the work in the History 
of Education, states that if he stresses any one thing in his courses, 
it is the relation of historical facts to modern problems. He points 
out that it is only for the sake of accuracy and definiteness that the 
examination questions seem to be confined to facts. He further points 
out that some of the questions themselves, while not specifically calling 
for relationships, nevertheless imply them, and that students know 
that a discussion of such relationships in their answers is approved 
and appropriately rewarded. 
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presented. Is it the chief function of the teacher of the 
history of education to make certain that his students are 
well informed as to the major facts in history, and can we 
then be reasonably sure that these students will draw upon 
this store of knowledge whenever facts therein will serve to 
modify present and future practice? Or is such modification 
not the ‘‘desirable outcome” of work in the history of edu- 
cation? Again, should the teacher of history give the facts, 
and the teachers of other subjects point out the applications 
of these historical facts? Whatever be the truth, the exa- 
aminations under study in this report do not indicate either 
(1) that the history of education is being taught with refer- 
ence to present educational issues, or (2) that historical 
issues are often raised in other courses in the school. In 
view of recent tendencies in the secondary schools to “‘ teach 
history backwards”—that is, to take present issues as a 
starting point—may not all teachers of education profitably 
study the question of connection suggested by the situation 
here revealed? 

Questions on the Future-——A similar discussion might be 
appropriate on questions concerning the future. Presuma- 
bly a school of education exists to help modify for the better 
educational practices and educational institutions. If stu- 
dents are taught to reason about education, will the skill 
therein gained transfer to their activities after they leave 
the university? Will they see desirable trends and promptly 
ally themselves therewith? Will they have the necessary 
power to distinguish truth from error in education and the 
necessary good will to act for the truth? It will be noted 
that 25 per cent of all the questions were concerned with use, 
and it may be maintained that such questions encourage 
and prepare for desirable attitudes leading to correct and 
effective action. But it may still be asked, should not the 
student sometimes be specifically required to turn his mind 
to the future, and, in a restricted field of study, try to fore- 
cast trends, so that he may be prepared for them? How- 
ever one may answer these theoretical issues, only fifteen 
of the 1,450 questions dealt specifically with the future. 
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Directions to Students.—Every teacher knows that students 
sometimes slip on even the simplest directions, answering 
too few or too many questions, misunderstanding the plain 
meaning of words, and otherwise failing to do themselves 
justice. Some teachers hold that the ability to follow printed 
directions is one of the abilities the examination itself may 
legitimately test. 

Beyond doubt, the element of surprise or confusion 
enters into many examination marks. At least one of the 
two hundred examinations under study had directions so 
complicated and involved that students must have been 
confused by them. Another had directions so scattered 
through the body of the examination itself that one hardly 
could feel sure of what was expected without prolonged study 
of the text. The examination which consisted of but one 
task, ‘‘Outline the major problems of this field,’’ and the 
other, ‘Select any question or questions which will show 
your grasp of this subject,’”” may or may not have been con- 
fusing. The first may lead one student to a factual repeti- 
tion of the subject matter of the course and a second student 
to a reasoned discussion of issues. The second question is 
likely to lead to an even greater variety of answers. ‘‘Grasp’’ 
is an elusive thing at best; it will be hard to convince students 
that luck does not enter into the result, unless, indeed, they 
have been adequately prepared for undertaking just such 
atask. One student may grasp firmly a single major strand, 
another will reach after all the threads, with an indifferent 
hold on any one. Which shall have the higher mark? 

The words “discuss” and “outline” are much used in 
examination questions, and not always accurately. Thus, 
in the questions, ‘‘ Discuss briefly the reasons for conducting 
physical examinations’’ and ‘Outline briefly the origin and 
development of psychological testing,’ perhaps the simpler 
word “‘give’’ or “‘tell’’ would serve as well as either. Dic- 
tionaries are accommodating, but “discuss” should be re- 
served for a consideration of the pros and cons of a real 
issue, and “outline” suggests the broad sketches of a plan 
rather than a condensed history or abstract. Experience in 
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reading examination books indicates that even graduate 
students commonly read questions without adequate atten- 
tion to the exact meaning of words: all the more reason for 
care in composing the questions and in giving the general 
and special directions for taking the examination. 

Some Miscellaneous Comments.—Just as references to the 
history of education may well be put into examination ques- 
tions, so also, if education is a coordinating agency, may 
references to economics, sociology, psychology, biology, phil- 
osophy, and other fields. Statistical comparisons of the 
several fields in the matter of these references would be 
invalid, since it is obvious that the influence of these outside 
subjects varies greatly among the several fields of education. 

Another interesting problem occurs in that field of edu- 
cation having to do with methods of teaching English, math- 
ematics, music, science, and other secondary school subjects. 
It has often been found that students who enroll in these 
courses are somewhat weak in the subject matter of instruc- 
tion. It thus becomes a desirable procedure to devote part 
of the time of the course to a review of this subject matter, 
and this policy is reflected in the examinations. But a 
minimum and maximum standard for such treatment in 
these courses and in their examinations might with profit 
be worked out and agreed upon. An occasional examina- 
tion deals so fully with subject matter, that there is little 
required on methods of teaching, and thus it may differ but 
little from an examination in the corresponding college de- 
partment. 

If the examination is an educative process (and no one 
can doubt it), should there not be an opportunity offered to 
talk over the results with the class—a post mortem examina- 
tion, as it were? One instructor composed brief specifica- 
tions for adequate answers to his examination questions, but 
found that very few students were interested in accepting 
his invitation to inspect them. Let bygones be bygones 
may be the usual student attitude; many of us, however, 
faced with the results of our teaching, have wished for one 
more meeting to straighten out misconceptions. 
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Skill, Technical Knowledge, and Wisdom.—One theory of 
education is that the real test of a student’s work is found 
in that part of his study of education which he takes with 
him and uses in his professional effort: the skill he shows in 
actual educational activity is the measure of his effective 
study of education. Under this theory the work of the 
courses is usually or largely concerned with technical knowl- 
edge and wisdom about educational activities, and such 
knowledge and wisdom exist in order that they may be used 
to modify the student’s activity and perfect his skill. If 
the theory is valid, it constitutes an argument for the use 
of cases in instruction and in examinations, and for much 
attention to questions having to do with uses: applying the 
work of the course, constructing plans, and solving problems. 
This theory bears upon our discussion above of the examina- 
tions on the history of education. If application is desired 
as the ultimate test, why not ask for it in our examinations? 
Mere checking the existence of wisdom or knowledge, out of 
relation to its use, may or may not mean anything for its 
future application. In the absence of data to answer one 
way or the other, the chances are that it might prove more 
worth while to encourage the transfer from theory to prac- 
tice, by asking directly about it. 

Well-balanced examinations should perhaps try to do 
several things. Three hours is sufficient to test many powers 
of the student. He should certainly reveal in definite 
fashion the technical bases of his solutions; hardly anything 
is more unsatisfactory than the answer which is sensible but 
childish in its simplicity, revealing a mind that is likely to 
go wrong as often as it goes right, because it does not take 
account of the facts and does not know the basic reasons 
for the statements made. The student should certainly be 
required to reveal wisdom; without it his knowledge will be 
mere sterile theory and his activity ineffective bustle. Fi- 
nally, he should be asked to indicate the uses of the knowl- 
edge and the wisdom acquired in the course; without that, 
just as in the case of faith without works, his knowledge and 
wisdom may be dead. 
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A few of the courses given in any school of education deal 
directly with uses, as for example courses in psychological 
tests and educational measurement. Moreover, what has 
just been said should not be interpreted as a criticism of the 
examinations under study in this report, since the examina- 
tion is only one of several methods used to measure the work 
of students. 

Further Study Needed.—This relationship which exists be- 
tween the final examination and the other several measures 
of ability requires further study, and the writer of this report 
hopes to present in a second paper statistical material bear- 
ing on the problem; viz, correlation coefficients among the 
several agencies of measurement. 

In his article, “‘The Art of Examination,” in the January, 
1926, Atlantic Monthly, President Lowell states three dis- 
inct objects of examinations: ‘‘(1) To measure the progress 
of pupils; (2) as a direct means of education; (3) to set a 
standard for achievement.” One of the advantages of a 
school of education which is relatively small is that the fac- 
ulty may study the art of examination cooperatively; and 
nothing is more likely to produce a well-knit group of teach- 
ers devoted to a common aim. The Harvard School is 
taking advantage of this opportunity in the preparation of 
questions for the ‘‘general examinations” for the degree of 
Master of Education, and for the degree of Doctor of Edu- 
cation. The two tasks are quite unlike, but, in each, indi- 
vidual instructors propose questions, which are carefully 
scrutinized by a representative committee of the faculty and 
are then composed into a unified whole by the group. Such 
integration of thought has important values for the members 
of the faculty, and it cannot fail to improve their skill in 
writing examinations for ordinary courses. Thus the proxi- 
mate beneficiaries, the students of the school, will profit, 
and through them the ultimate beneficiaries, the pupils in 
schools. 

Joun M. BREWER, 
Harvard University. 
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Skill, Technical Knowledge, and Wisdom.—One theory of 
education is that the real test of a student’s work is found 
in that part of his study of education which he takes with 
him and uses in his professional effort: the skill he shows in 
actual educational activity is the measure of his effective 
study of education. Under this theory the work of the 
courses is usually or largely concerned with technical knowl- 
edge and wisdom about educational activities, and such 
knowledge and wisdom exist in order that they may be used 
to modify the student’s activity and perfect his skill. If 
the theory is valid, it constitutes an argument for the use 
of cases in instruction and in examinations, and for much 
attention to questions having to do with uses: applying the 
work of the course, constructing plans, and solving problems. 
This theory bears upon our discussion above of the examina- 
tions on the history of education. If application is desired 
as the ultimate test, why not ask for it in our examinations? 
Mere checking the existence of wisdom or knowledge, out of 
relation to its use, may or may not mean anything for its 
future application. In the absence of data to answer one 
way or the other, the chances are that it might prove more 
worth while to encourage the transfer from theory to prac- 
tice, by asking directly about it. 

Well-balanced examinations should perhaps try to do 
several things. Three hours is sufficient to test many powers 
of the student. He should certainly reveal in definite 
fashion the technical bases of his solutions; hardly anything 
is more unsatisfactory than the answer which is sensible but 
childish in its simplicity, revealing a mind that is likely to 
go wrong as often as it goes right, because it does not take 
account of the facts and does not know the basic reasons 
for the statements made. The student should certainly be 
required to reveal wisdom; without it his knowledge will be 
mere sterile theory and his activity ineffective bustle. Fi- 
nally, he should be asked to indicate the uses of the knowl- 
edge and the wisdom acquired in the course; without that, 
just as in the case of faith without works, his knowledge and 
wisdom may be dead. 
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A few of the courses given in any school of education deal 
directly with uses, as for example courses in psychological 
tests and educational measurement. Moreover, what has 
just been said should not be interpreted as a criticism of the 
examinations under study in this report, since the examina- 
tion is only one of several methods used to measure the work 
of students. 

Further Study Needed.—This relationship which exists be- 
tween the final examination and the other several measures 
of ability requires further study, and the writer of this report 
hopes to present in a second paper statistical material bear- 
ing on the problem; viz, correlation coefficients among the 
several agencies of measurement. 

In his article, ‘‘The Art of Examination,” in the January, 
1926, Atlantic Monthly, President Lowell states three dis- 
inct objects of examinations: ‘‘(1) To measure the progress 
of pupils; (2) as a direct means of education; (3) to set a 
standard for achievement.’’ One of the advantages of a 
school of education which is relatively small is that the fac- 
ulty may study the art of examination cooperatively; and 
nothing is more likely to produce a well-knit group of teach- 
ers devoted to a common aim. The Harvard School is 
taking advantage of this opportunity in the preparation of 
questions for the ‘‘general examinations’’ for the degree of 
Master of Education, and for the degree of Doctor of Edu- 
cation. The two tasks are quite unlike, but, in each, indi- 
vidual instructors propose questions, which are carefully 
scrutinized by a representative committee of the faculty and 
are then composed into a unified whole by the group. Such 
integration of thought has important values for the members 
of the faculty, and it cannot fail to improve their skill in 
writing examinations for ordinary courses. Thus the proxi- 
mate beneficiaries, the students of the school, will profit, 
and through them the ultimate beneficiaries, the pupils in 
schools. 

Joun M. BREWER, 
Harvard University. 











Records of Usage 


ECORDS of usage are the necessary foundation of all 

R constructive action. Originally such records were 

mere memories in individual minds. But though 

such memory records are incomplete, colored by personality 

and not conveniently comparable, mankind has used them 

well in building the complex industrial order in which we 
now live. 

As life becomes more intricate and cooperation more 
universal, the records of usage on which action is based 
necessarily become more complete, impersonal, and com- 
parable. The accelerating material conquests of engineer- 
ing, business, and finance are impossible without significant 
records of usage which supply stimulating facts on which 
the creative imagination may build. 

In the field of human relations, records of usage have 
been made for the purpose of organizing peoples for politics 
and for war. Such records show how men labor and fight 
under orders. Social status largely determines what each 
does. But now men are organizing for work. Personal 
skill is the significant factor. What a man does determines 
his social and political status. Usage has changed funda- 
mentally, and new kinds of records must be made as a basis 
for constructive action. 

Adventures always begin here and now. To proceed 
rationally in developing the new human organization for 
work, the first step is to record current usage—What do 
people really do? There is need of a written record that 
reveals in detail what kinds of personal skills are now being 
used to do the world’s work and how those skills are coor- 
dinated to play the game well. Such a record supplies the 
data for ever-increasing release of personal skills in ever- 
improving team play to make goods cheap and men dear. 

During the past ten years considerable experience has 
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been had in making the kinds of records of usage that are 
needed as a basis for perfecting the human organization for 
work. A simple, practical procedure that achieves the 
desired results has been evolved. This can best be described 
by working out a single example. For this purpose, the 
record of usage for a Foreign Service Officer of the United 
States will be used. This record of usage has been de- 
veloped in cooperation with the State Department. In cases 
like this, which treat only of the activities of a single individ- 
ual, such a record of usage is generally called a “job 
specification.” 

The first step in making a record of usage for personnel 
purposes is to list all the activities that are characteristic of 
the work, identifying each by a short appropriate phrase. 
For example, in the case of a Foreign Service Officer: 


Protect American citizens. 

Protect American interests. 

Make political and economic reports. 

Hold consular courts in extraterritorial countries. 

Execute depositions and commissions. 

Administer relief, protection and burial of American seamen in 
foreign countries. 

Administer estates of American seamen. 

Enforce the laws concerning American citizenship. 

Issue passports to Americans. 

Enforce alien visa control. 

Report deaths and administer estates of deceased Americans. 

Witness and certify American marriages. 

Record and report vital statistics. 


Experience has shown that such lists are most useful when 
each item describes activities that can be observed objec- 
tively. It will be noted that each item begins with a verb 
denoting action. It will also be noted that the items do 
not indicate what knowledge is prerequisite or what par- 
ticular modes of performance are required. Therefore the 
list as it stands does not give the full picture that is needed 
to select men for foreign service or to guide them in their 
daily work. 

In order to supply these deficiencies it has been suggested 
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that the list of activities be preceded by a list of prerequisites; 
for example, the Foreign Service Officer must know inter- 
national law and understand American interests and foreign 
policies. It is of course clear that the Foreign Service 
Officer must have this information, but it has been found by 
experience to serve the purpose better if such requirements, 
which present definite conditions of action or describe essen- 
tial modes of performance, are embodied in the list itself by 
adding phrases to the several items. Take, for example, the 
item, “‘ Protect American citizens.’’ If this item is expanded 
by adding “‘in accordance with international law,’’ it defines 
simultaneously both the action and a limiting condition on 
which success of the action depends. The revised item would 
then read, “Protect American citizens in accordance with 
international law.” 

Even in this form, the item is not complete. For success 
in protecting Americans depends in large measure on diplo- 
matic skill and on having a legitimate case. Therefore the 
item more nearly states actual conditions if, for the word 
‘‘protect,”’ the phrase “make effective representations to the 
authorities of foreign governments concerning the protection 
of” is substituted. Also the protection afforded is properly 
limited to “rights and property.” Hence a correct and 
adequate statement for this item is: 


Make effective representations to the authorities of foreign govern- 
ments concerning the protection of American citizens, their rights and 
their property, in accordance with international law. 


As a second example of this type of expansion of the 
several items consider the following: 

‘Make political and economic reports.” 

This is too large an order. Limitations must be set by 
denoting the purpose for which the reports are intended and 
by indicating that only significant facts are wanted. Both 
of these limitations are made clear by rewording the item 
to read: 


Analyze and report on political and economic conditions and trends 
of significance in formulating the policies of the United States. 
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By treating each of the items in the original list in this 
manner the record of usage eventually takes on the form 
shown below. This is not submitted as a final and 
perfect record of usage for the work of a Foreign Service 
Officer but as a sample of the mode of producing a record of 
usage that will be a valuable guide to the State Department 
in selecting men for training as Foreign Service Officers and 
to young men who want to know if they are best qualified 
for foreign service and to schools that aim to train young 
men for foreign service. 

It will be noted that in the final form the items in the 
record of usage have not only been expanded but have been 
reclassified in groups of major and minor objectives. The 
basis of this classification is functional activity and is so 
obvious as to need no further explanation. 

For purposes of classification it is convenient to preface 
the list of items with a brief statement of the general purpose 
and setting of each particular occupation, as shown in the 
sample. Also the items themselves are called ‘“‘objectives”’ 
because they set the standard of expert performance which 
every Foreign Service Officer seeks to achieve. 


FOREIGN SERVICE OFFICER 
OF THE UNITED STATES 


Represents United States Government abroad as diplomat, consul or 
special representative at conferences, congresses, et cetera. 

Generally stationed in a foreign country where he has to act on own 
responsibility and not under immediate supervision of home authorities. 
Objectives: 

Promote and protect the interests of the United States and of its 

citizens. 

Negotiate protocols, conventions and treaties, regarding interna- 
tional intercourse, tariffs, shipping, commerce, peace, et cetera. 

Make effective representations to the authorities of foreign 
governments concerning the protection of American citizens, 
their rights and their property, in accordance with inter- 
national law. 

Further an accurate knowledge and a friendly understanding of 
the United States in foreign countries and of those foreign 
countries in the United States. 
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Understand his own country and be unremitting in his endeavors 
to learn about and to understand deeply the foreign country 
in which he is stationed. 

Advise and assist traveling business men and tourists. 

Apply when necessary, any knowledge or experience gained in 
previous positions held. 

Cooperate and counsel with superior officers and colleagues on 
all matters relating to his official duties. 

Give fundamental information and instructions to colleagues 
and subordinates in assigning problems, investigations, duties, 
et cetera. 


Analyze and report on political and economic conditions and trends 


of significance in formulating the policies of the United States. 


Analyze and report on market conditions, statistics of trade, of 
production, of labor, et cetera, in foreign countries in so far 
as they are significant to merchants in the United States. 

Analyze and report on crops and other agricultural, forest, 
fishing, and mining resources in so far as they may affect 
similar American interests. 

Analyze and report on shipping practices, freights, charters, 
shipping pools, etc., as far as they affect American operators. 

Report on tariffs, both laws and practices. 

Report vital statistics of Americans abroad. 

Reply to individual trade inquiries from American citizens. 


Issue passports to American citizens, register citizens and advise on 


questions relating to citizenship generally. 


Issue Bills of Health, make sanitary reports and supervise 
disinfection of merchandise. 

Certify invoices of all goods shipped to the United States report- 
ing on undervaluations for protection of revenues. 

Visa alien passports under immigration laws. 

Enter and clear American ships, administer relief of seamen, 
sign on and discharge seamen, settle disputes between masters 
and seamen, take charge of shipwrecked vessels. 

Assist in prevention of importation of prohibited articles under 
prohibition and anti-narcotic laws. 

Administer regulations relating to plant and animal quarantine. 

Take custody of estates of deceased American citizens and 
sailors. 

Handle extradition cases. 

Witness marriages, where one or both of the participants is an 
American citizen, in accordance with Federal and State laws. 

Perform notarial services in accordance with Federal and State 
laws. 
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Administer an office. 


Apportion responsibility and work among personnel, report on 
personnel. 


Organize files of correspondence received and sent. 

Estimate needs of office and plan outlays for present and future 
activities (Budget). 

Receive, care, and account for public property in accordance with 
government regulations. 


Collect and properly account for fees for services rendered 
under law. 


Disburse funds received from the Treasury of the United States 
for salaries, wages, contingent supplies, make up various 
returns and accounts, and remit surplus funds to Treasury. 

The foregoing is a sample of a record of usage for one 
individual occupation. The same form is effective for 
recording the practices of groups or of entire corporations. 
From the foregoing it appears that a record of usage may be 
thus defined: 


A record of usage is an accurate list of the essential actions and 
modes of performance of an expert when successfully achieving a 
particular purpose. 

Experience is making it clear that a record of usage like 
the foregoing sample is the basic need for wise selection, 
vocational guidance, or construction of educational courses. 
To many it may appear incomplete because it does not call 
for ratings on personal traits and character. Experience is, 
however, showing that such ratings are not necessary for 
adequately describing the limiting conditions and modes of 
performance that are essential to success. If such limiting 
conditions and modes of performance are properly incorpo- 
rated in the body of the specification, then anyone who 
successfully does the things specified has the proper personal 
qualifications. The question of personality may arise when 
an individual has to work closely with a group. In such 
cases personal ratings may be useful; but even so it makes 
for better ultimate results if such ratings are not mixed up 
with the record of usage and the personal equation is treated 
as a wholly separate matter. 

The need for records of usage, or job specifications, of this 
type is steadily increasing in business and industrial organ- 
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izations, on the one hand, and in educational institutions 
on the other. The social organization is changing rapidly. 
Professional, political, business and educational practices 
are in a state of constant flux in an effort to keep up with 
the changing times. Such records of usage constitute the 
ground map of the present situation, making it possible to 
see clearly where changes are needed. These necessary 
changes can then be made with full knowledge of their 
effect on the organization as a whole. 

A record of usage, properly drawn in the form herewith 
presented, contains all the information needed as a sound 
basis for organizing men for work. If business and the 
professions write their records of usage approximately in this 
form, the data from different occupations are comparable. 
Then these records also give educational institutions the 
basic facts they need to discover what activities and modes 
of procedure are common to many phases of the world’s 
work. When schools know what these fundamental common 
elements of human action are, they can release the corre- 
sponding personal skills in youth and stimulate constructive 
thinking about a world that is now organizing for work. 
This is the kind of school product America must have if it is 
to achieve the mission to which it is dedicated. 

C. R. MANN. 











Achievement Tests 


HE Committee on Personnel Methods awaiting the 
completion of its study of available achievement tests, 
calls attention to standardized tests suited to the uses 

of secondary schools and colleges. 

In the following list an asterisk preceding a title indicates 
that the test named is a revision of one used in the Pennsyl- 
vania survey in the spring of 1928. Since all data from the 
survey are not available, only tentative norms are furnished. 
The publishers of these tests will appreciate the return to 
them of the Report to Author which is attached to the 
Class Record. In return the publishers will furnish the 
results of the data received to those who cooperate. 

Except No. 1 and No. 25 all tests are put up in packages 
of 25 test booklets, a teachers’ Manual of Directions giving 
complete instructions for administering and scoring, a Scor- 
ing Key and Class Record. The prices per package are net 
F.O.B. publishers’ shipping point. Orders for all except 
Nos. 1 and 25 must be for unbroken packages. 

Orders for No. 1 should be addressed to the American 
Council on Education, 26 Jackson Place, Washington, D. C. 

Orders for No. 25 should be addressed to Stanford Uni- 
versity Press, Stanford University, California. 

Orders for all the others should be sent to the World Book 
Company, Yonkers, New York. 


1. AMERICAN COUNCIL ON EDUCATION PSYCHOLOGICAL EXAMINA- 
TION, 1928 edition, by L. L. Thurstone and Thelma Gwinn Thurstone, 
American Council on Education, 26 Jackson Place, Washington, D. C. 
Price: $9.00 for 100 copies of the examination. 

Description: The five parts of this test are printed in an eight-page 
booklet and require one hour for giving: Completion, 10 minutes; 
Artificial Language, 11 minutes; Analogies (by Lewis O. Anderson, 
University of North Dakota), 12 minutes; Arithmetic, 20 minutes; 
Opposites, 7 minutes. 

2. AMERICAN CouNCIL ALPHA FRENCH TEsT, by V. A. C. Henmon, 
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A. Coleman and M. R. Trabue. World Book Company, Yonkers, 
New York. Price: $1.25 for 25 of each part. 

Forms and Years: Two forms each of two parts for all four years of 
French study. 

Time: 40 minutes for Part I; 40 minutes for Part II. 

Description: The test is in two parts, each part being printed in a 
separate booklet. Part I contains a test in vocabulary and a test in 
grammar. The vocabulary test consists of 75 French words each 
followed by five English meanings, the pupil to select the correct mean- 
ing. The grammar test consists of 14 parts with 50 items. Part II 
contains a test in silent reading and one in composition. The reading 
test consists of seven French paragraphs, each followed by several 
French questions on the paragraph to be answered in English. The 
composition test calls for a composition based on a picture given in 
the test booklet. 

3. AMERICAN CounciIL ALPHA GERMAN TEsT, by V. A. C. Henmon, 
B. O. Morgan, S. M. Hinz, C. M. Purin and E. Rossberg. World 
Book Company, Yonkers, New York. Price: $1.25 for 25 of each part. 

Forms and Years: Two forms each of two parts for all four years of 
German study. 

Time: Part I, 45 minutes; Part II, 40 minutes. 

Description: Part I contains two tests. The first is a vocabulary 
test containing 100 German words with five English meanings for each; 
the pupil is to indicate the one of the five that is correct. The second 
is a grammar test made up of 50 sentences with five translations for 
each, of which the pupil is to indicate the correct one. Part II con- 
tains two tests, the first calling for a composition based on a picture 
given in the test booklet, the second a test of silent reading containing 
seven German reading selections, each followed by several questions 
in German on the selection to be answered in English. 

4. AMERICAN COUNCIL ON EDUCATION. GERMAN READING SCALES, 
by M. J. Van Wagenen and S. H. Patterson. Public School Publishing 
Company, Bloomington, Illinois. Price: $.75 for package of 25. 

Forms and Years: One form each of Division 1 for first and second 
years and of Division 2 for the second and third years. 

Time: 50 minutes. 

Description: The test includes a series of German paragraphs each 
followed by questions. It tests the student’s ability to understand 
German paragraphs given in the Scales. 

5. AMERICAN COUNCIL ALPHA SPANISH TEST, by M. A. Buchanan, 
J. P. W. Crawford, H. Keniston and V. A. C. Henmon. World Book 
Company, Yonkers, New York. Price: $1.25 for 25 of each part. 

Forms and Years: Two forms each of two parts for all four years of 
Spanish study. 

Time: Part I, 37 minutes; Part II, 40 minutes. 
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Description: The test is in two parts, each part being printed in a 
separate booklet. Part I contains a test in vocabulary and a test in 
grammar. The vocabulary test consists of 75 Spanish words each 
followed by five English meanings, the pupil to select the correct mean- 
ing. The grammar test consists of 14 parts with 50 items. Part II 
consists of a test in silent reading and one in composition. The reading 
test consists of seven Spanish paragraphs, each followed by several 
Spanish questions on the paragraph to be answered in English. The 
composition test calls for a composition based on a picture given in the 
test booklet. 

6. *AMERICAN COUNCIL CIVICS AND GOVERNMENT TeEsT, by R. D. 
Leigh, J. D. McGoldrick, P. H. Odegard, and B. D. Wood. World 
Book Company, Yonkers, New York. Price: $1.50 for package of 25. 

Forms and Years: Two forms for high school and college. (Form 
A now available; Form B in preparation). 

Time: 90 minutes. 

Description: The test is in four parts. Part I contains 108 true- 
false statements. Part II contains 13 groups of items to be matched, 
with 65 items in all. Part III contains 24 multiple choice questions, 
and Part IV, 25 short answer questions. The test covers the subject 
comprehensively and includes questions on both facts and relationships 
in Civics and Government. 

7. *AMERICAN CoUNCIL Economics Test, by H. Taylor, T. N. Bar- 
rows and B. D. Wood. World Book Company, Yonkers, New York. 
Price: $1.30 for package of 25. 

Forms and Years: Two forms for high school and college. (Form A 
now available; Form B in preparation). 

Time: 90 minutes. 

Description: The test isin three parts. Part I contains 90 true-false 
statements. Part II contains 12 groups of items to be matched, with 
60 items in all. Part III contains 25 multiple choice questions. The 
test covers the subject comprehensively and includes questions on both 
facts and relationships in Economics. 

8. *AMERICAN COUNCIL EUROPEAN History TEst, by H. J. Carman, 
W. C. Langsam and B. D. Wood. World Book Company, Yonkers, 
New York. Price: $1.50 for package of 25. 

Forms and Years: Two forms for high school and college. (Form A 
now available; Form B in preparation). 

Time: 90 minutes. 

Description: This test has four parts. Part I contains 70 true-false 
statements. Part II contains 10 groups of items to be matched with 
50 items in all. Part III contains 45 multiple choice questions, and 
Part IV, 20 short answer questions. The test covers the subject com- 
prehensively and includes questions on both facts and relationships in 
European History. 
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9. *AMERICAN CounciL SoLip Geometry Test, by H. W. Rauden- 
bush, L. P. Siceloff, and B. D. Wood. World Book Company, Yonkers, 
New York. Price: $1.25 for package of 25. 

Forms and Years: Two forms for high school and college. (Form 
A now available; Form B in preparation.) 

Time: 60 minutes. 

Description: This test is in two parts. Part I contains 92 true-false 
statements concerning facts and relationships in solid geometry. Part 
II contains 28 problems. 

10. *AMERICAN COUNCIL TRIGONOMETRY TEST, by H. W. Rauden- 
bush, L. P. Siceloff and B. D. Wood. World Book Company, Yonkers, 
New York. Price: $1.25 for package of 25. 

Forms and Years: Two forms for high school and college. (Form A 
mow available; Form B in preparation.) 

Time: 60 minutes. 

Description: This test is in two parts. Part I contains 92 true-false 
statements concerning facts and relationships in solid geometry. Part 
II contains 28 problems. 

11. CoLUMBIA RESEARCH BUREAU ALGEBRA TEsT, by A. S. Otis 
and B. D. Wood. World Book Company, Yonkers, New York. Price: 
$1.30 for package of 25. 

Forms: A and B. 

Time: Thirty minutes for each of the two parts. 

Description: The test covers a year’s work in algebra. It has two 
parts. The first part contains 20 equations the solution of which in- 
volves many of the mechanical phases of algebra. The second part 
consists of 20 problems and graphs. 

12. CoLUMBIA RESEARCH BUREAU AMERICAN History TEsT, by 
H. J. Carman, T. N. Barrows and B. D. Wood. World Book Company, 
Yonkers, New York. Price: $1.50 for package of 25. 

Forms and Years: Two forms for high school and college. 

Time: 120 minutes. 

Description: The test is in four parts. Part I contains 80 true-false 
statements. Part II contains 8 groups of items to be matched with 
50 items in all. Part III contains 50 multiple choice questions, and 
Part IV, 20 short answer questions. The test covers the subject com- 
prehensively and includes questions on both facts and relationships 
in American History. 

13. CoLUMBIA RESEARCH BuREAU ENGLIsH TEsT, by H. R. Stevens, 
A. Abbott and B. D. Wood. World Book Company, Yonkers, New 
York. Price: $1.50 for package of 25. 

Forms and Years: Forms A and B for high school and college. 

Time: Two hours. 

Description: This test has four parts (1) Spelling 40 words—to 
choose the one of four given ways which is the correct spelling of each 
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word; (2) Mechanics—a paragraph in which corrections are to be 
made; (3) Vocabulary, 100 words—multiple choice type, four choices 
for each word; (4) Literary knowledge, 100 items of the multiple choice 
type, four choices for each item. 

14. CoLumBIA RESEARCH BuREAU FRENCH TEST, by A. A. Meras, 
Suzanne Roth and B. D. Wood. World Book Company, Yonkers, 
New York. Price: $1.30 for package of 25. 

Forms and Years: Two forms for second, third and fourth years of 
French study. 

Time: 90 minutes. 

Description: The test has three parts. Part I is a vocabulary test 
containing 100 French words each followed by 5 English meanings of 
which the pupil is to indicate the correct one. Part II is a compre- 
hension test containing 75 French statements following each of which 
the pupil is to indicate whether it is true or false. Part III is a gram- 
mar test containing 100 English sentences with the French translation 
of each. One word or phrase of the translation is omitted, which the 
pupil is to supply. 

15. CoLUMBIA RESEARCH BUREAU GERMAN TEsT, by C. M. Purin 
and B.D. Wood. World Book Company, Yonkers, New York. Price: 
$1.30 for package of 25. 

Forms and Years: Two forms for all four years of German study. 

Time: 90 minutes. 

Description: The test has three parts. Part I is a vocabulary test 
containing 100 German words each followed by 5 English meanings 
of which the pupil is to indicate the correct one. Part II is a compre- 
hension test containing 75 German statements, following each of 
which the pupil is to indicate whether it is true or false. Part III is 
a grammar test containing 100 English sentences with the German trans- 
lation of each. One word or phrase of the translation is omitted, which 
the pupil is to supply. 

16. CoLUMBIA RESEARCH BuREAU Puysics Test, by H. W. Farwell 
and B. D. Wood. World Book Company, Yonkers, New York. Price: 
$1.30 for package of 25. 

Forms: Two forms, A and B. 

Time: 75 minutes. 

Description: The test consists of 144 true-false questions, both in- 
formational and reasoning. 

17. CoLUMBIA RESEARCH BUREAU PLANE GEOMETRY TEST, by H. 
E. Hawkes and B. D. Wood. World Book Company, Yonkers, New 
York. Price: $1.20 for package of 25. 

Forms: A and B. 

Time: 60 minutes. 

Description: The test has two parts. Part I contains 65 true-false 
statements on geometrical facts. Part II contains 35 problems. 
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18. CoLUMBIA RESEARCH BuREAU SPANISH TEST, by F. Callcott 
and B. D. Wood. World Book Company, Yonkers, New York. Price: 
$1.30 for package of 25. 

Forms and Years: Two forms for second, third, and fourth years of 
Spanish study. 

Time: 90 minutes. 

Description: The test has three parts. Part I is a vocabulary test 
containing 100 Spanish words each followed by 5 English meanings 
of which the pupil is to indicate the correct one. Part II is a compre- 
hension test containing 75 Spanish statements, following each of which 
the pupil is to indicate whether it is true or false. Part III is a gram- 
mar test containing 100 English sentences with the Spanish translation 
of each. One word or phrase of the translation is omitted, which the 
pupil is to supply. 

19. Cross ENGLISH Test, by E. A. Cross. World Book Company, 
Yonkers, New York. Price: $1.20 for package of 25, 

Forms and Years: Forms A, B and C for high school and first year 
college. 

Time: 45 minutes. 

Description: The test consists of the following: 

1. Spelling in which 32 pairs of words are given, the one correctly 
spelled to be checked. 

2. Pronunciation in which 32 words are given with two pronunciations 
in code (the code being explained) the correct pronunciation to be 
checked. 

3. Sentence recognition. 

4, Punctuation. 

. Verb forms. 
. Pronoun forms. 
. Idiomatic expressions. 

8. Miscellaneous faulty expressions. 

20. Otis Group INTELLIGENCE SCALE, by A. S. Otis, World Book 
Company, Yonkers, New York. Price: $1.25 for package of 25. 

Forms and Years: Two forms for grade 5 up to adult level. 

Time: 45 minutes for the test proper (about 60 minutes in all). 

Description: The test is in ten parts each part testing a different 
phase of mental ability—ability to follow directions, recognition of 
opposites, organization of written thought, matching meanings, arith- 
metical problems, special relationships, analogies, similarities, comple- 
tion, memory. 

21. Powers GENERAL CHEMISTRY TEST, by S. R. Powers. World 
Book Company, Yonkers, New York. Price: $1.10 for package of 25. 

Forms and Years: Two forms for high school chemistry. 

Time: 35 minutes. 

Description: The test is in two parts. Part I contains 30 multiple 
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choice questions that test range of information. Part II contains 27 
problems, 

22. RucH-CossMAN BrioLocy Test, by G. M. Ruch and L. H. Coss- 
man. World Book Company, Yonkers, New York. Price: $1.30 for 
package of 25. 

Forms: Forms A and B. 

Time: 38 minutes. 

Description: Part I of the test contains 40 multiple choice items of 
information. Part II contains 18 multiple choice reasoning questions. 
Part III contains 15 items which are to be matched with numbered 
items in pictures. Part IV contains a problem on the subject of the 
Mendelian Inheritance. Part V contains 5 problems in the forms of 
completion paragraphs. Norms are available at the end of the year. 

23. RucH-POPENOE GENERAL SCIENCE Test, by G. M. Ruch and 
H. F. Popenoe. World Book Company, Yonkers, New York. Price: 
$1.30 for package of 25. 

Forms: Forms A and B. 

Time: 40 minutes. 

Description: The test consists of Part I, containing 50 multiple 
choice information questions; and Part II, containing 20 problems 
each referring to a picture or diagram. 

24. TERMAN Group TEST OF MENTAL ABILITy, by L. M. Terman. 
World Book Company, Yonkers, New York. Price: $1.20 for package 
of 25. 

Forms and Years: Two forms from grade 7 up to adult level. 

Time: 27 minutes for the test proper (about 35 minutes in all). 

Description: The test is in 10 parts, each testing one measure of 
mental ability—information, selection of best answer, similarity and 
opposite, logical selection, arithmetical problems, sentence meaning, 
analogies, organization, classification, number series. 

25. STRONG VOCATIONAL INTEREST BLANK, by E. K. Strong, Jr. 
Stanford University Press, Stanford University, California. Price: 25 
copies for $2.00; 100 copies, $6.00; 500 or more, $5.00 a hundred. 

Scales for following occupations now available: Advertiser, Archi- 
tect, Certified Public Accountant, Chemist, Engineer, Journalist (News- 
paper Editor), Lawyer, Minister, Psychologist and School Teacher 
and Administrator. Price: $1.00 each. 
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